[ 603.627530] env[69656]: INFO neutron.common.config [-] Logging enabled! [ 603.627780] env[69656]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 26.1.0.dev34 [ 603.627986] env[69656]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69656) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 603.628300] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 603.628399] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 603.629210] env[69656]: WARNING oslo_policy.policy [None req-d7792017-c957-47a0-862d-c3c76742241a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 603.629465] env[69656]: WARNING oslo_policy.policy [None req-d7792017-c957-47a0-862d-c3c76742241a None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 603.630925] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-d7792017-c957-47a0-862d-c3c76742241a None None] VMware NSXv3 Agent initialized successfully. [ 603.631291] env[69656]: DEBUG oslo_concurrency.lockutils [None req-d7792017-c957-47a0-862d-c3c76742241a None None] Acquiring lock "singleton_lock" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.631432] env[69656]: DEBUG oslo_concurrency.lockutils [None req-d7792017-c957-47a0-862d-c3c76742241a None None] Acquired lock "singleton_lock" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.631636] env[69656]: DEBUG oslo_concurrency.lockutils [None req-d7792017-c957-47a0-862d-c3c76742241a None None] Releasing lock "singleton_lock" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.631918] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] Full set of CONF: {{(pid=69656) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 603.632140] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ******************************************************************************** {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 603.632263] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] Configuration options gathered from: {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 603.632496] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 603.632665] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 603.632777] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ================================================================================ {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 603.632948] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] agent_down_time = 75 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.633108] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] allow_automatic_dhcp_failover = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.633254] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] allow_bulk = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.633404] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] api_extensions_path = {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.633548] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] api_paste_config = api-paste.ini {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.633693] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] auth_strategy = keystone {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.633804] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] backdoor_port = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.633913] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] backdoor_socket = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.634069] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] backlog = 4096 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.634207] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] base_mac = fa:16:3e:00:00:00 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.634365] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] bind_host = 0.0.0.0 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.634515] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] bind_port = 9696 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.634652] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] client_socket_timeout = 900 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.634796] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] config_dir = [] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.634934] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.635102] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] config_source = [] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.635247] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] control_exchange = neutron {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.635396] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] core_plugin = ml2 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.635571] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] debug = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.635723] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] default_availability_zones = [] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.635945] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.636094] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] dhcp_agent_notification = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.636230] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] dhcp_agents_per_network = 1 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.636374] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] dhcp_lease_duration = 86400 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.636527] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] dhcp_load_type = networks {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.636669] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] dns_domain = openstacklocal {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.636816] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.636965] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] enable_default_route_bfd = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.637146] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] enable_default_route_ecmp = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.637297] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] enable_dvr = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.637440] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] enable_new_agents = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.637578] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.637718] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] enable_signals = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.637859] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] enable_traditional_dhcp = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.637992] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] external_dns_driver = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.638147] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] filter_validation = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.638298] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] global_physnet_mtu = 8950 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.638437] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] graceful_shutdown_timeout = 60 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.638616] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] host = cpu-1 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.638772] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] host_dvr_for_dhcp = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.638913] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] http_retries = 3 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.639067] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] instance_format = [instance: %(uuid)s] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.639217] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.639382] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ipam_driver = internal {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.639532] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ipv6_pd_enabled = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.639678] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] l3_ha = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.639819] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.639960] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] l3_ha_network_physical_name = {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.640115] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] l3_ha_network_type = {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.640257] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] log_color = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.640397] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] log_config_append = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.640538] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.640673] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] log_dir = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.640805] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] log_file = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.640918] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] log_options = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.641179] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] log_rotate_interval = 1 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.641352] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] log_rotate_interval_type = days {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.641555] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] log_rotation_type = none {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.641686] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.641800] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.641971] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.642114] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.642228] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.642373] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] max_dns_nameservers = 5 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.642514] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] max_header_line = 16384 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.642654] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] max_l3_agents_per_router = 3 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.642793] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] max_logfile_count = 30 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.642929] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] max_logfile_size_mb = 200 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.643077] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] max_subnet_host_routes = 20 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.643228] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] my_ip = 10.180.1.21 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.643373] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] my_ipv6 = ::1 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.643512] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] network_auto_schedule = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.643648] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] network_link_prefix = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.643791] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.643938] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] notify_nova_on_port_data_changes = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.644092] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] notify_nova_on_port_status_changes = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.644241] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] pagination_max_limit = -1 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.644380] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] publish_errors = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.644518] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] rate_limit_burst = 0 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.644663] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] rate_limit_except_level = CRITICAL {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.644802] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] rate_limit_interval = 0 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.644973] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] retry_until_window = 30 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.645149] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] router_distributed = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.645293] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] rpc_resources_processing_step = 20 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.645432] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] rpc_response_max_timeout = 600 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.645573] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] rpc_response_timeout = 60 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.645712] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] send_events_interval = 2 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.645867] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] service_plugins = ['router'] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.646024] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] setproctitle = on {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.646167] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] shell_completion = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.646309] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] state_path = /opt/stack/data/neutron {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.646453] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] syslog_log_facility = LOG_USER {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.646591] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] tcp_keepidle = 600 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.646735] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] transport_url = **** {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.646875] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] use_journal = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.647045] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] use_json = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.647203] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] use_ssl = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.647343] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] use_stderr = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.647493] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] use_syslog = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.647671] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] vlan_qinq = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.647814] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] vlan_transparent = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.647962] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] watch_log_file = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.648149] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] wsgi_default_pool_size = 100 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.648295] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] wsgi_keep_alive = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.648444] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.648584] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] wsgi_server_debug = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 603.648737] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_concurrency.disable_process_locking = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.648890] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.649051] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.649244] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.649345] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.649493] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.649633] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.649789] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler.connection_string = messaging:// {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.649934] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler.enabled = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.650094] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler.es_doc_type = notification {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.650239] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler.es_scroll_size = 10000 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.650385] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler.es_scroll_time = 2m {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.650530] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler.filter_error_trace = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.650677] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler.hmac_keys = **** {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.650824] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler.sentinel_service_name = mymaster {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.650973] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler.socket_timeout = 0.1 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.651129] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler.trace_requests = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.651275] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler.trace_sqlalchemy = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.651427] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler_jaeger.process_tags = {} {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.651567] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler_jaeger.service_name_prefix = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.651768] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] profiler_otlp.service_name_prefix = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.651856] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_policy.enforce_new_defaults = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.652195] env[69656]: WARNING oslo_config.cfg [None req-d7792017-c957-47a0-862d-c3c76742241a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 603.652337] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_policy.enforce_scope = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.652497] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_policy.policy_default_rule = default {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.652653] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.652800] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.652948] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.653099] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.653242] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.653380] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.653519] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.653663] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_policy.remote_timeout = 60.0 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.653820] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.653971] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] agent.extensions = [] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.654134] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.654283] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] service_providers.service_provider = [] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.654429] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] QUOTAS.default_quota = -1 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.654581] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.654723] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] QUOTAS.quota_floatingip = 50 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.654864] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] QUOTAS.quota_network = 100 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.655038] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] QUOTAS.quota_port = 500 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.655199] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.655345] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] QUOTAS.quota_router = 10 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.655488] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] QUOTAS.quota_security_group = 10 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.655630] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.655769] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] QUOTAS.quota_subnet = 100 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.655910] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] QUOTAS.track_quota_usage = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.656076] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.656236] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep.group = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.656354] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep.helper_command = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.656498] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.656637] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep.thread_pool_size = 8 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.656774] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep.user = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.656972] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.657102] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_dhcp_release.group = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.657249] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_dhcp_release.helper_command = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.657394] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.657534] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.657670] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_dhcp_release.user = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.657817] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.657965] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_ovs_vsctl.group = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.658130] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_ovs_vsctl.helper_command = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.658279] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.658422] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.658559] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_ovs_vsctl.user = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.658705] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_namespace.capabilities = [21] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.658843] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_namespace.group = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.658979] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_namespace.helper_command = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.659136] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.659280] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_namespace.thread_pool_size = 8 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.659432] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_namespace.user = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.659565] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_conntrack.capabilities = [12] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.659700] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_conntrack.group = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.659835] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_conntrack.helper_command = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.659980] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.660172] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.660319] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_conntrack.user = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.660471] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_link.capabilities = [12, 21] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.660609] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_link.group = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.660746] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_link.helper_command = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.660887] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.661037] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_link.thread_pool_size = 8 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.661179] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] privsep_link.user = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.661337] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.661485] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.661629] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.continue_on_failed_promotions = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.661770] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.dscp = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.661913] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.dscp_inherit = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.662073] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.force_mp_to_policy = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.662220] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.locking_coordinator_url = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.662362] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.log_agent_heartbeats = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.662504] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.logging_expire = 1 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.662652] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.662794] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.662943] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.polling_interval = 240 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.663099] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.663251] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.663402] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.report_interval = 30.0 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.663555] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.663704] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.663851] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.663995] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.sync_skew = 60 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.664150] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.synchronization_queue_size = 20 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.664295] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT.use_helper_for_ns_read = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.664447] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] SECURITYGROUP.enable_ipset = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.664596] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] SECURITYGROUP.enable_security_group = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.664744] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.664892] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.665101] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] experimental.ipv6_pd_enabled = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.665209] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ml2.extension_drivers = ['port_security'] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.665353] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ml2.external_network_type = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.665510] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.665667] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ml2.overlay_ip_version = 4 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.665798] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ml2.path_mtu = 8950 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.665942] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ml2.physical_network_mtus = {} {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.666102] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ml2.tenant_network_types = ['vlan'] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.666252] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.666399] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ml2.type_drivers = ['vlan'] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.666546] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT_CLI.neutron_port_id = [] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.666686] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.666824] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.666994] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.667169] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.667319] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.667465] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.667612] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.667759] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.667953] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.668147] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_login_password = **** {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.668307] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_login_port = 443 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.668457] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_login_user = admin {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.668609] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.668762] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.668907] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.669061] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.669215] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.669368] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.669515] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.669662] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.669806] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.669954] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.670120] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.670268] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.670419] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.670612] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.670767] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] vsphere.vsphere_login_password = VMware1! {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.670916] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.671072] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.671222] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] nova.auth_section = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.671374] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] nova.auth_type = password {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.671521] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.671658] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] nova.certfile = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.671834] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] nova.collect_timing = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.672055] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] nova.endpoint_type = public {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.672134] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] nova.insecure = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.672275] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] nova.keyfile = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.672422] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] nova.region_name = RegionOne {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.672589] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] nova.split_loggers = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.672727] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] nova.timeout = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.672873] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] placement.auth_section = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.673032] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] placement.auth_type = password {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.673184] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.673321] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] placement.certfile = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.673459] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] placement.collect_timing = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.673603] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] placement.endpoint_type = public {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.673741] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] placement.insecure = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.673875] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] placement.keyfile = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.674014] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] placement.region_name = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.674155] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] placement.split_loggers = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.674291] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] placement.timeout = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.674440] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.auth_section = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.674573] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.auth_type = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.674708] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.cafile = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.674842] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.certfile = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.675045] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.collect_timing = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.675227] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.connect_retries = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.675375] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.connect_retry_delay = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.675516] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.enable_notifications = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.675653] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.endpoint_override = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.675793] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.insecure = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.675930] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.interface = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.676078] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.keyfile = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.676218] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.max_version = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.676389] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.min_version = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.676526] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.region_name = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.676665] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.retriable_status_codes = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.676801] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.service_name = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.676935] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.service_type = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.677092] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.split_loggers = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.677232] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.status_code_retries = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.677408] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.status_code_retry_delay = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.677504] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.timeout = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.677637] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.valid_interfaces = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.677769] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ironic.version = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.677911] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] cli_script.dry_run = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.678116] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.678264] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.678405] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.678544] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.678681] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.678818] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.678955] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.679110] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.679252] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.679402] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.679547] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.679787] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.679824] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.679971] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.680148] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.680369] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.680529] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.680671] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.680822] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.680963] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.681116] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.681262] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.681407] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.681549] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.681750] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.681896] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.682049] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.682195] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.682339] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.682480] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.682619] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.ssl = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.682768] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.682911] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.683063] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.683214] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.683357] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.ssl_version = {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.683496] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.683645] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_notifications.driver = [] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.683785] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_notifications.retry = -1 {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.683937] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.684086] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] oslo_messaging_notifications.transport_url = **** {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 603.684200] env[69656]: DEBUG oslo_service.backend.eventlet.service [None req-d7792017-c957-47a0-862d-c3c76742241a None None] ******************************************************************************** {{(pid=69656) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 603.685226] env[69656]: DEBUG neutron.agent.securitygroups_rpc [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Init firewall settings (driver=nsxv3) {{(pid=69656) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 603.686521] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69656) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 603.686763] env[69656]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] RPC agent_id: nsxm-l-01a.corp.local [ 603.689047] env[69656]: DEBUG dogpile.cache.region [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 603.689172] env[69656]: DEBUG dogpile.lock [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.689275] env[69656]: DEBUG dogpile.lock [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.689370] env[69656]: DEBUG dogpile.lock [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.689490] env[69656]: DEBUG dogpile.cache.region [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 603.689572] env[69656]: DEBUG dogpile.lock [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.689690] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.710286] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Session token - acquiring [ 603.711858] env[69656]: DEBUG networking_nsxv3.common.locking [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.712062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.712154] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.712562] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.723056] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.987064] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 604.010547] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.010728] env[69656]: DEBUG dogpile.cache.region [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Cache value generated in 0.321 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 604.010800] env[69656]: DEBUG dogpile.lock [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.010925] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Activating Policy API Provider. [ 604.011133] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Looking for the default Infrastructure Rules. [ 604.085014] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Looking for the Default Layer3 Logged Drop Section. [ 604.100361] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 604.100951] env[69656]: DEBUG networking_nsxv3.common.locking [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.101465] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquiring lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.101599] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.101864] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired external semaphore "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.102207] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.618260] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.120730] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.623392] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Inventory metadata is going to be refreshed. [ 605.623651] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 606.440395] env[69656]: DEBUG networking_nsxv3.common.locking [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.440931] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.440931] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.441098] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.453326] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 606.566507] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.567611] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 606.585130] env[69656]: DEBUG networking_nsxv3.common.locking [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.585341] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.585414] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.585745] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.585884] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.586048] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 606.586166] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 606.586276] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 606.606772] env[69656]: DEBUG networking_nsxv3.common.locking [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.607040] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.607209] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.607455] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.607636] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.607791] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 606.625701] env[69656]: DEBUG networking_nsxv3.common.locking [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.626053] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.626053] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.626303] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.626455] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.626608] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 606.646468] env[69656]: DEBUG networking_nsxv3.common.locking [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.646696] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquiring lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.646824] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.647098] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired external semaphore "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.647267] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Releasing lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.647430] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 606.647539] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 606.647645] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 606.665232] env[69656]: DEBUG networking_nsxv3.common.locking [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.665480] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquiring lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.665611] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.665813] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired external semaphore "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.665937] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Releasing lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.666100] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 606.666210] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 606.666316] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 606.684215] env[69656]: DEBUG networking_nsxv3.common.locking [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.684432] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.684472] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.684766] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.684981] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.685188] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 606.685299] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 606.685401] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Inventory metadata have been refreshed. [ 606.685524] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Dryrun:True. Metadata refresh completed. [ 606.685665] env[69656]: DEBUG oslo_concurrency.lockutils [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Releasing lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.687728] env[69656]: INFO neutron.agent.agent_extensions_manager [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Loaded agent extensions: [] [ 606.688475] env[69656]: DEBUG neutron_lib.callbacks.manager [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69656) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 606.694525] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.694734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.694734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.695036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.695288] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.756300] env[69656]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] NSXv3 Agent Agent RPC Daemon Started! [ 606.756585] env[69656]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] NSXv3 Agent Agent loop - iteration:0 started [ 606.756585] env[69656]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] NSXv3 Agent Agent out of sync with plugin! [ 607.197332] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.700277] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.202741] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 608.202968] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 608.903192] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.903735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.903735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.903735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.917232] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 608.918089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.918689] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 608.934562] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.934798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.934798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.935070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.935185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.935695] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 608.935695] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 608.935695] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 608.952122] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.952304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.952304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.952474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.952595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.952692] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 608.969274] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.969436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.969436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.969606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.969700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.969797] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 608.985198] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.985312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.985408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.985525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.985612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.985712] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 608.985784] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 608.985851] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 609.000371] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.000497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.000538] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.000689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.000768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.000858] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 609.000931] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 609.000998] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 609.017830] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.017950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.018049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.018199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.018290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.018391] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 609.018464] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 609.018531] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 609.018596] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 609.018668] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 609.018728] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 609.018789] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 609.019044] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 609.019119] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 609.019166] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 609.036397] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.036552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.036596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.036715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.036807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.036902] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 609.053097] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.053219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.053269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.053476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.053533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.083386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.688849] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 611.689293] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 616.689907] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 616.690292] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 621.690907] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 621.691289] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 624.095627] env[69656]: INFO networking_nsxv3.common.synchronization [None req-dec06d7b-ab8e-470e-9ed0-d39fb1e78803 demo admin] Enqueued Resource ID: 5f4ab381-1749-4755-af84-76d3fabe564c with Priority: HIGHEST for action security_group_rules [ 624.096308] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f4ab381-1749-4755-af84-76d3fabe564c with Priority: HIGHEST for action security_group_rules [ 624.096701] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f4ab381-1749-4755-af84-76d3fabe564c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.096881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f4ab381-1749-4755-af84-76d3fabe564c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.096955] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f4ab381-1749-4755-af84-76d3fabe564c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.097313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f4ab381-1749-4755-af84-76d3fabe564c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.097433] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f4ab381-1749-4755-af84-76d3fabe564c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.621570] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.621570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.621570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.621570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.621570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.621570] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f4ab381-1749-4755-af84-76d3fabe564c already deleted. [ 624.621570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f4ab381-1749-4755-af84-76d3fabe564c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.097020] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 629.097413] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 634.097818] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 634.098253] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 639.098652] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 639.099027] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 644.099738] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 644.100172] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 648.266726] env[69656]: INFO networking_nsxv3.common.synchronization [None req-3b007508-4b6e-4375-8b63-be8ffab54d43 None None] Enqueued Resource ID: 229a411c-534c-430e-a251-d8e957344164 with Priority: HIGHEST for action port [ 648.266981] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 229a411c-534c-430e-a251-d8e957344164 with Priority: HIGHEST for action port [ 648.267370] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-229a411c-534c-430e-a251-d8e957344164 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.267491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-229a411c-534c-430e-a251-d8e957344164" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.267574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-229a411c-534c-430e-a251-d8e957344164" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.267865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-229a411c-534c-430e-a251-d8e957344164" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.267969] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('229a411c-534c-430e-a251-d8e957344164',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.314473] env[69656]: INFO networking_nsxv3.common.synchronization [None req-cb845e35-d154-4eee-a116-eea3919d81f9 None None] Enqueued Resource ID: 9578340b-8f92-44a6-8ef4-d4c5499994e3 with Priority: HIGHEST for action port [ 648.314473] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9578340b-8f92-44a6-8ef4-d4c5499994e3 with Priority: HIGHEST for action port [ 648.314473] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-9578340b-8f92-44a6-8ef4-d4c5499994e3 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.314473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9578340b-8f92-44a6-8ef4-d4c5499994e3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.314473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9578340b-8f92-44a6-8ef4-d4c5499994e3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.314871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9578340b-8f92-44a6-8ef4-d4c5499994e3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.314871] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9578340b-8f92-44a6-8ef4-d4c5499994e3',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.774753] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 229a411c-534c-430e-a251-d8e957344164 [ 648.774753] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.774753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.774753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.774753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.774753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.774753] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:229a411c-534c-430e-a251-d8e957344164 already deleted. [ 648.774753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-229a411c-534c-430e-a251-d8e957344164" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.818882] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9578340b-8f92-44a6-8ef4-d4c5499994e3 [ 648.818882] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.818882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.818882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.819095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.819603] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.819603] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9578340b-8f92-44a6-8ef4-d4c5499994e3 already deleted. [ 648.819603] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9578340b-8f92-44a6-8ef4-d4c5499994e3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.903482] env[69656]: INFO networking_nsxv3.common.synchronization [None req-e34b17b2-7092-4b40-907c-edb1f08ea36e None None] Enqueued Resource ID: 18230e6c-fe43-48e0-8a97-fec743c72f29 with Priority: HIGHEST for action port [ 649.903482] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18230e6c-fe43-48e0-8a97-fec743c72f29 with Priority: HIGHEST for action port [ 649.904231] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-18230e6c-fe43-48e0-8a97-fec743c72f29 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.904231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18230e6c-fe43-48e0-8a97-fec743c72f29" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.904496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18230e6c-fe43-48e0-8a97-fec743c72f29" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.904531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18230e6c-fe43-48e0-8a97-fec743c72f29" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.904704] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18230e6c-fe43-48e0-8a97-fec743c72f29',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.406779] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18230e6c-fe43-48e0-8a97-fec743c72f29 [ 650.406845] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.406934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.407011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.407378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.407378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.407485] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18230e6c-fe43-48e0-8a97-fec743c72f29 already deleted. [ 650.407622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18230e6c-fe43-48e0-8a97-fec743c72f29" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.654329] env[69656]: INFO networking_nsxv3.common.synchronization [None req-a4d689e6-8b7d-42b5-8cb2-c09b5c9ecb04 None None] Enqueued Resource ID: 787c837d-af70-43ad-81fe-adb8591d4f59 with Priority: HIGHEST for action port [ 650.654397] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787c837d-af70-43ad-81fe-adb8591d4f59 with Priority: HIGHEST for action port [ 650.658498] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-787c837d-af70-43ad-81fe-adb8591d4f59 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.658758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-787c837d-af70-43ad-81fe-adb8591d4f59" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.658758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-787c837d-af70-43ad-81fe-adb8591d4f59" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.659072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-787c837d-af70-43ad-81fe-adb8591d4f59" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.659158] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('787c837d-af70-43ad-81fe-adb8591d4f59',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.162411] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 787c837d-af70-43ad-81fe-adb8591d4f59 [ 651.162684] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.163447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.163447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.163447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.163447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.163447] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:787c837d-af70-43ad-81fe-adb8591d4f59 already deleted. [ 651.163447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-787c837d-af70-43ad-81fe-adb8591d4f59" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.054185] env[69656]: INFO networking_nsxv3.common.synchronization [None req-2ec24c80-0b00-468f-a0dc-c2f8ddf340a0 None None] Enqueued Resource ID: da45eade-c996-446a-bc43-2c9a450ce3c2 with Priority: HIGHEST for action port [ 652.054185] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da45eade-c996-446a-bc43-2c9a450ce3c2 with Priority: HIGHEST for action port [ 652.054185] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-da45eade-c996-446a-bc43-2c9a450ce3c2 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.054185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da45eade-c996-446a-bc43-2c9a450ce3c2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.054185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da45eade-c996-446a-bc43-2c9a450ce3c2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.054185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da45eade-c996-446a-bc43-2c9a450ce3c2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.055466] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da45eade-c996-446a-bc43-2c9a450ce3c2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.559535] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da45eade-c996-446a-bc43-2c9a450ce3c2 [ 652.559535] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.559535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.559535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.559535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.559535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.559535] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da45eade-c996-446a-bc43-2c9a450ce3c2 already deleted. [ 652.559535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da45eade-c996-446a-bc43-2c9a450ce3c2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.617673] env[69656]: INFO networking_nsxv3.common.synchronization [None req-68915ab8-d59a-49e2-adf5-fd5d9ccf63d8 None None] Enqueued Resource ID: e5cab854-5608-4903-af67-9e318471e28e with Priority: HIGHEST for action port [ 653.617960] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5cab854-5608-4903-af67-9e318471e28e with Priority: HIGHEST for action port [ 653.618521] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5cab854-5608-4903-af67-9e318471e28e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.618683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5cab854-5608-4903-af67-9e318471e28e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.618752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5cab854-5608-4903-af67-9e318471e28e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.618987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5cab854-5608-4903-af67-9e318471e28e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.619082] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5cab854-5608-4903-af67-9e318471e28e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.800348] env[69656]: INFO networking_nsxv3.common.synchronization [None req-ddac7112-9735-48f1-b4e2-a259a23b553d None None] Enqueued Resource ID: e86b8d3b-183e-4fd0-a118-4d4546d23b23 with Priority: HIGHEST for action port [ 653.800348] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86b8d3b-183e-4fd0-a118-4d4546d23b23 with Priority: HIGHEST for action port [ 653.801041] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e86b8d3b-183e-4fd0-a118-4d4546d23b23 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.801041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e86b8d3b-183e-4fd0-a118-4d4546d23b23" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.801041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e86b8d3b-183e-4fd0-a118-4d4546d23b23" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.801210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e86b8d3b-183e-4fd0-a118-4d4546d23b23" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.801210] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e86b8d3b-183e-4fd0-a118-4d4546d23b23',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.121520] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5cab854-5608-4903-af67-9e318471e28e [ 654.121520] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.121520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.121520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.121520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.121520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.121520] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5cab854-5608-4903-af67-9e318471e28e already deleted. [ 654.121520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5cab854-5608-4903-af67-9e318471e28e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.277971] env[69656]: INFO networking_nsxv3.common.synchronization [None req-e456fab4-6dd7-42f7-8506-abe14279e02e None None] Enqueued Resource ID: af3f1fd9-43e1-4ae2-898b-031a863fd414 with Priority: HIGHEST for action port [ 654.278425] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af3f1fd9-43e1-4ae2-898b-031a863fd414 with Priority: HIGHEST for action port [ 654.278752] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-af3f1fd9-43e1-4ae2-898b-031a863fd414 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.279024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af3f1fd9-43e1-4ae2-898b-031a863fd414" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.279024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af3f1fd9-43e1-4ae2-898b-031a863fd414" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.281255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af3f1fd9-43e1-4ae2-898b-031a863fd414" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.281312] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af3f1fd9-43e1-4ae2-898b-031a863fd414',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.303615] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e86b8d3b-183e-4fd0-a118-4d4546d23b23 [ 654.303838] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.304276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.304276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.304400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.304431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.304532] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e86b8d3b-183e-4fd0-a118-4d4546d23b23 already deleted. [ 654.304614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e86b8d3b-183e-4fd0-a118-4d4546d23b23" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.785616] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af3f1fd9-43e1-4ae2-898b-031a863fd414 [ 654.785616] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.785986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.785986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.785986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.786101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.786136] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af3f1fd9-43e1-4ae2-898b-031a863fd414 already deleted. [ 654.786205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af3f1fd9-43e1-4ae2-898b-031a863fd414" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.894205] env[69656]: INFO networking_nsxv3.common.synchronization [None req-77a1ddcf-85c8-4b55-8ebb-7a752366166d None None] Enqueued Resource ID: 90108689-dd00-4a80-b92d-a15f2b22c823 with Priority: HIGHEST for action port [ 655.894490] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90108689-dd00-4a80-b92d-a15f2b22c823 with Priority: HIGHEST for action port [ 655.896549] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-90108689-dd00-4a80-b92d-a15f2b22c823 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.896685] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90108689-dd00-4a80-b92d-a15f2b22c823" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.896841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90108689-dd00-4a80-b92d-a15f2b22c823" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.897206] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90108689-dd00-4a80-b92d-a15f2b22c823" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.897304] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90108689-dd00-4a80-b92d-a15f2b22c823',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.284088] env[69656]: INFO networking_nsxv3.common.synchronization [None req-1f9ade0c-1cc0-4750-a1d8-795ef781ed5c None None] Enqueued Resource ID: 7670ab81-fad5-4012-b8ca-b95412148ce1 with Priority: HIGHEST for action port [ 656.284295] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7670ab81-fad5-4012-b8ca-b95412148ce1 with Priority: HIGHEST for action port [ 656.284962] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-7670ab81-fad5-4012-b8ca-b95412148ce1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.284962] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7670ab81-fad5-4012-b8ca-b95412148ce1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.285084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7670ab81-fad5-4012-b8ca-b95412148ce1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.285851] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7670ab81-fad5-4012-b8ca-b95412148ce1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.285851] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7670ab81-fad5-4012-b8ca-b95412148ce1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.401345] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90108689-dd00-4a80-b92d-a15f2b22c823 [ 656.401345] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.401345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.401345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.401345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.401345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.401345] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90108689-dd00-4a80-b92d-a15f2b22c823 already deleted. [ 656.401345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90108689-dd00-4a80-b92d-a15f2b22c823" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.789424] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7670ab81-fad5-4012-b8ca-b95412148ce1 [ 656.789653] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.790479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.790479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.790479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.790479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.790479] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7670ab81-fad5-4012-b8ca-b95412148ce1 already deleted. [ 656.790479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7670ab81-fad5-4012-b8ca-b95412148ce1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.924015] env[69656]: INFO networking_nsxv3.common.synchronization [None req-118b48e7-1e5b-4fa3-b4e0-45728c039ce4 None None] Enqueued Resource ID: 878311ad-4b8b-4c64-8b0f-8a4187cfce67 with Priority: HIGHEST for action port [ 657.924609] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 878311ad-4b8b-4c64-8b0f-8a4187cfce67 with Priority: HIGHEST for action port [ 657.924934] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-878311ad-4b8b-4c64-8b0f-8a4187cfce67 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.926100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-878311ad-4b8b-4c64-8b0f-8a4187cfce67" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.927567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-878311ad-4b8b-4c64-8b0f-8a4187cfce67" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.927567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-878311ad-4b8b-4c64-8b0f-8a4187cfce67" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.927567] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('878311ad-4b8b-4c64-8b0f-8a4187cfce67',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.429470] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 878311ad-4b8b-4c64-8b0f-8a4187cfce67 [ 658.429773] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.430190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.430190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.430458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.430551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.430692] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:878311ad-4b8b-4c64-8b0f-8a4187cfce67 already deleted. [ 658.430821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-878311ad-4b8b-4c64-8b0f-8a4187cfce67" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.973188] env[69656]: INFO networking_nsxv3.common.synchronization [None req-1a4a616b-f697-4bc9-9694-4402e87179c8 None None] Enqueued Resource ID: 0d336773-a8ad-4b5b-a643-7e1126e500ab with Priority: HIGHEST for action port [ 658.973453] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d336773-a8ad-4b5b-a643-7e1126e500ab with Priority: HIGHEST for action port [ 658.974050] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d336773-a8ad-4b5b-a643-7e1126e500ab taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.974171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d336773-a8ad-4b5b-a643-7e1126e500ab" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.974237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d336773-a8ad-4b5b-a643-7e1126e500ab" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.976285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d336773-a8ad-4b5b-a643-7e1126e500ab" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.976680] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d336773-a8ad-4b5b-a643-7e1126e500ab',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.482178] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d336773-a8ad-4b5b-a643-7e1126e500ab [ 659.482501] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.482718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.482749] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.483025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.483231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.483365] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d336773-a8ad-4b5b-a643-7e1126e500ab already deleted. [ 659.483478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d336773-a8ad-4b5b-a643-7e1126e500ab" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.668904] env[69656]: INFO networking_nsxv3.common.synchronization [None req-5c9f11e5-a913-409f-b638-597c175c60a4 tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGHEST for action security_group_rules [ 660.669528] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGHEST for action security_group_rules [ 660.669741] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.669861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.669920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.671164] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.671248] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.730158] env[69656]: INFO networking_nsxv3.common.synchronization [req-674adaa2-1597-43d3-90f3-78056471253e req-69d47883-3558-4924-945f-8157045986b3 tempest-InstanceActionsTestJSON-574695347 tempest-InstanceActionsTestJSON-574695347-project-member] Enqueued Resource ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 with Priority: HIGHEST for action security_group_members [ 660.730158] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 with Priority: HIGHEST for action security_group_members [ 660.732121] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c27843-e365-4bd4-9103-dc94b0c2a637 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.733499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.733613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.733890] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.734081] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.734459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.734459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.734459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.734636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.734636] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7c27843-e365-4bd4-9103-dc94b0c2a637',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.824793] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d10b4dd5-8407-47cb-9f46-b2843cb26dc2 None None] Enqueued Resource ID: 00b635aa-5aec-4ae4-988d-f98babaf3ef4 with Priority: HIGHEST for action port [ 660.824987] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b635aa-5aec-4ae4-988d-f98babaf3ef4 with Priority: HIGHEST for action port [ 660.825556] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-00b635aa-5aec-4ae4-988d-f98babaf3ef4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.825687] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00b635aa-5aec-4ae4-988d-f98babaf3ef4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.825757] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00b635aa-5aec-4ae4-988d-f98babaf3ef4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.826078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00b635aa-5aec-4ae4-988d-f98babaf3ef4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.826211] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00b635aa-5aec-4ae4-988d-f98babaf3ef4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.875332] env[69656]: INFO networking_nsxv3.common.synchronization [None req-5f86da8e-1c3b-4459-9481-ba5e55f2dfc8 None None] Enqueued Resource ID: 89ac62a6-9601-4c54-9cf1-67b29fb61a55 with Priority: HIGHEST for action port [ 660.875641] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89ac62a6-9601-4c54-9cf1-67b29fb61a55 with Priority: HIGHEST for action port [ 660.876315] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-89ac62a6-9601-4c54-9cf1-67b29fb61a55 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.876418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89ac62a6-9601-4c54-9cf1-67b29fb61a55" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.876616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89ac62a6-9601-4c54-9cf1-67b29fb61a55" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.876885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89ac62a6-9601-4c54-9cf1-67b29fb61a55" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.876978] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89ac62a6-9601-4c54-9cf1-67b29fb61a55',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.965196] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d0a1b467-2e1f-4e69-9536-ccdef51d4564 tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGHEST for action security_group_rules [ 660.965713] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGHEST for action security_group_rules [ 660.966208] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.966208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.189923] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.190099] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.190320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.190830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.190830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.190830] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 already deleted. [ 661.190830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.190830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.191021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.191265] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.238026] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.238026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.238026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.238026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.238026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.238026] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.238026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.238026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.238605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.238664] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.238966] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 already deleted. [ 661.238966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.328396] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00b635aa-5aec-4ae4-988d-f98babaf3ef4 [ 661.329620] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.330478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.330478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.334112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.334112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.334112] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00b635aa-5aec-4ae4-988d-f98babaf3ef4 already deleted. [ 661.334112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00b635aa-5aec-4ae4-988d-f98babaf3ef4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.380386] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89ac62a6-9601-4c54-9cf1-67b29fb61a55 [ 661.380386] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.380386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.380386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.380386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.380386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.380386] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89ac62a6-9601-4c54-9cf1-67b29fb61a55 already deleted. [ 661.380386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89ac62a6-9601-4c54-9cf1-67b29fb61a55" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.527341] env[69656]: INFO networking_nsxv3.common.synchronization [None req-c14bd6a6-e708-4895-b0c1-acacc7cac7e9 None None] Enqueued Resource ID: 541fe030-2613-4dca-a06f-248a0006b4c8 with Priority: HIGHEST for action port [ 661.527341] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 541fe030-2613-4dca-a06f-248a0006b4c8 with Priority: HIGHEST for action port [ 661.527341] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-541fe030-2613-4dca-a06f-248a0006b4c8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.527341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-541fe030-2613-4dca-a06f-248a0006b4c8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.527341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-541fe030-2613-4dca-a06f-248a0006b4c8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.533165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-541fe030-2613-4dca-a06f-248a0006b4c8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.533165] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('541fe030-2613-4dca-a06f-248a0006b4c8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.711497] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.711799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.712000] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.712304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.712459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.712597] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 already deleted. [ 661.712729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.919124] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-32 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.919124] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-32" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.919124] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-32" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.922444] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-32" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.922444] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.922444] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.922444] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.922444] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.922444] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.923935] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.924680] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.924680] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.924680] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.924680] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.925593] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.925846] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.947717] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.947899] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 661.948294] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.948349] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-32" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.948712] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-583cff26-0813-4dfe-b978-b4d65e3ca895 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.948864] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-583cff26-0813-4dfe-b978-b4d65e3ca895" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.948993] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-583cff26-0813-4dfe-b978-b4d65e3ca895" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.949357] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-583cff26-0813-4dfe-b978-b4d65e3ca895" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.950217] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('583cff26-0813-4dfe-b978-b4d65e3ca895',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.034868] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 541fe030-2613-4dca-a06f-248a0006b4c8 [ 662.034868] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.034868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.034868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.034868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.034868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.034868] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:541fe030-2613-4dca-a06f-248a0006b4c8 already deleted. [ 662.034868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-541fe030-2613-4dca-a06f-248a0006b4c8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.453458] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.454701] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.454701] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.456070] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.456243] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.456418] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 583cff26-0813-4dfe-b978-b4d65e3ca895 not found, creating... [ 662.456714] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.457429] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.457429] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.457429] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.457429] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.457851] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.457956] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.458285] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.458485] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.459604] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.459604] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 583cff26-0813-4dfe-b978-b4d65e3ca895 is going to be created. [ 662.498096] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.498290] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.498419] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.498689] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.498993] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.499204] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-583cff26-0813-4dfe-b978-b4d65e3ca895" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.056304] env[69656]: INFO networking_nsxv3.common.synchronization [req-a2cafc07-dd8a-467e-90ff-71ef3299551e req-b2042965-4ac6-489e-9751-505b95610d07 tempest-ImagesOneServerTestJSON-1256148964 tempest-ImagesOneServerTestJSON-1256148964-project-member] Enqueued Resource ID: 4a133f47-cf05-42f1-8365-6a566b72e14d with Priority: HIGHEST for action security_group_members [ 663.056304] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a133f47-cf05-42f1-8365-6a566b72e14d with Priority: HIGHEST for action security_group_members [ 663.057485] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a133f47-cf05-42f1-8365-6a566b72e14d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.057485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.057485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.057485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.057678] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.057678] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.057802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.057920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.058239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.058239] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a133f47-cf05-42f1-8365-6a566b72e14d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.360101] env[69656]: INFO networking_nsxv3.common.synchronization [None req-0082f08e-cff9-4d31-a7fd-6db92173e3d8 None None] Enqueued Resource ID: 055c58af-635b-4a61-87fe-933a19cc007b with Priority: HIGHEST for action port [ 663.360354] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 055c58af-635b-4a61-87fe-933a19cc007b with Priority: HIGHEST for action port [ 663.360933] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-055c58af-635b-4a61-87fe-933a19cc007b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.361095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-055c58af-635b-4a61-87fe-933a19cc007b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.361192] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-055c58af-635b-4a61-87fe-933a19cc007b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.361719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-055c58af-635b-4a61-87fe-933a19cc007b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.361825] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('055c58af-635b-4a61-87fe-933a19cc007b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.560249] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.560410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.560484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.560684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.561297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.561297] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.561297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.561297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.561464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.561464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.561464] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a133f47-cf05-42f1-8365-6a566b72e14d already deleted. [ 663.561555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.779766] env[69656]: INFO networking_nsxv3.common.synchronization [req-674adaa2-1597-43d3-90f3-78056471253e req-c0b6bc8b-6d09-45c8-8855-daaab4850af1 service nova] Enqueued Resource ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 with Priority: HIGHEST for action security_group_rules [ 663.780169] env[69656]: INFO networking_nsxv3.common.synchronization [req-674adaa2-1597-43d3-90f3-78056471253e req-c0b6bc8b-6d09-45c8-8855-daaab4850af1 service nova] Enqueued Resource ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 with Priority: HIGHEST for action security_group_members [ 663.780169] env[69656]: INFO networking_nsxv3.common.synchronization [req-674adaa2-1597-43d3-90f3-78056471253e req-c0b6bc8b-6d09-45c8-8855-daaab4850af1 service nova] Enqueued Resource ID: 583cff26-0813-4dfe-b978-b4d65e3ca895 with Priority: HIGHEST for action port [ 663.780369] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 with Priority: HIGHEST for action security_group_rules [ 663.780495] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 with Priority: HIGHEST for action security_group_members [ 663.780588] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583cff26-0813-4dfe-b978-b4d65e3ca895 with Priority: HIGHEST for action port [ 663.783878] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7c27843-e365-4bd4-9103-dc94b0c2a637 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.783878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.783878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.784119] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.784119] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7c27843-e365-4bd4-9103-dc94b0c2a637',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.785129] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c27843-e365-4bd4-9103-dc94b0c2a637 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.785129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.785211] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.785311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.785450] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.785541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.785601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.785759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.786735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.786735] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7c27843-e365-4bd4-9103-dc94b0c2a637',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.788293] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-583cff26-0813-4dfe-b978-b4d65e3ca895 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.791752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-583cff26-0813-4dfe-b978-b4d65e3ca895" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.791752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-583cff26-0813-4dfe-b978-b4d65e3ca895" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.791752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-583cff26-0813-4dfe-b978-b4d65e3ca895" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.791752] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('583cff26-0813-4dfe-b978-b4d65e3ca895',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.865758] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 055c58af-635b-4a61-87fe-933a19cc007b [ 663.865884] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.866043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.866700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.866700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.866700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.866700] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:055c58af-635b-4a61-87fe-933a19cc007b already deleted. [ 663.866700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-055c58af-635b-4a61-87fe-933a19cc007b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.122616] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.123212] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-265" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.123469] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-265" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.123969] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-265" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.124367] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.124665] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.124881] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.125688] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.125977] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.126366] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.126600] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.126822] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.128276] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.128276] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.128276] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.128276] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.131745] env[69656]: INFO networking_nsxv3.common.synchronization [None req-70aa890b-b403-432a-80ef-0c090e327e8d tempest-ServersTestBootFromVolume-403368592 tempest-ServersTestBootFromVolume-403368592-project-member] Enqueued Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGHEST for action security_group_rules [ 664.132640] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGHEST for action security_group_rules [ 664.133107] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53bb734e-5b1e-47d3-a1af-56162bde2894 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.133174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.133207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.133419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.133522] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53bb734e-5b1e-47d3-a1af-56162bde2894',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.148742] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.148932] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 664.149093] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.149284] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-265" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.149588] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-f4a05c40-0c0e-4114-bb61-c91ae2b05472 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.150915] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-f4a05c40-0c0e-4114-bb61-c91ae2b05472" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.151211] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-f4a05c40-0c0e-4114-bb61-c91ae2b05472" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.151567] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-f4a05c40-0c0e-4114-bb61-c91ae2b05472" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.151706] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4a05c40-0c0e-4114-bb61-c91ae2b05472',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.291464] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c27843-e365-4bd4-9103-dc94b0c2a637 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.291593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.304585] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7c27843-e365-4bd4-9103-dc94b0c2a637',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.305644] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 583cff26-0813-4dfe-b978-b4d65e3ca895 with status ACTIVE [ 664.305996] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.306112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.306112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.306315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.306400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.306572] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.306665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.306725] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.306870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.306944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.307137] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.307226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.307294] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.307432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.307538] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.307580] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 583cff26-0813-4dfe-b978-b4d65e3ca895 is going to be updated. [ 664.330783] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.330924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.331838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.332027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.332174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.332351] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-583cff26-0813-4dfe-b978-b4d65e3ca895" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.538861] env[69656]: INFO networking_nsxv3.common.synchronization [None req-c73aa58d-cb68-4e19-932e-8736033cbc78 tempest-ServersTestBootFromVolume-403368592 tempest-ServersTestBootFromVolume-403368592-project-member] Enqueued Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGHEST for action security_group_rules [ 664.538861] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGHEST for action security_group_rules [ 664.538861] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53bb734e-5b1e-47d3-a1af-56162bde2894 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.538861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.607055] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d55b169e-602a-41ff-8375-862cf2833ced None None] Enqueued Resource ID: eb7ecab4-2e5d-45f6-bd1e-ff7674178904 with Priority: HIGHEST for action port [ 664.607055] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb7ecab4-2e5d-45f6-bd1e-ff7674178904 with Priority: HIGHEST for action port [ 664.619143] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb7ecab4-2e5d-45f6-bd1e-ff7674178904 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.619143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb7ecab4-2e5d-45f6-bd1e-ff7674178904" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.619143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb7ecab4-2e5d-45f6-bd1e-ff7674178904" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.619143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb7ecab4-2e5d-45f6-bd1e-ff7674178904" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.619143] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb7ecab4-2e5d-45f6-bd1e-ff7674178904',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.654138] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.654138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.654138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.654648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.654648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.654648] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 already deleted. [ 664.654648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.656869] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.657081] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.657204] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.657457] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.657600] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.661330] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port f4a05c40-0c0e-4114-bb61-c91ae2b05472 not found, creating... [ 664.661443] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.662991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.662991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.662991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.662991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.662991] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.662991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.662991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.662991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.662991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.663299] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: f4a05c40-0c0e-4114-bb61-c91ae2b05472 is going to be created. [ 664.665173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.665173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.665173] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53bb734e-5b1e-47d3-a1af-56162bde2894',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.680755] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.682615] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.682615] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.682615] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.682615] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.682615] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-f4a05c40-0c0e-4114-bb61-c91ae2b05472" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.813087] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7c27843-e365-4bd4-9103-dc94b0c2a637',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.054168] env[69656]: INFO networking_nsxv3.common.synchronization [None req-b0223bdd-5a73-44cf-84d4-e9b7198a04b9 None None] Enqueued Resource ID: f65db341-17fe-4dc4-a064-23bebb46f3c0 with Priority: HIGHEST for action port [ 665.054168] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65db341-17fe-4dc4-a064-23bebb46f3c0 with Priority: HIGHEST for action port [ 665.054168] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-f65db341-17fe-4dc4-a064-23bebb46f3c0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.054168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f65db341-17fe-4dc4-a064-23bebb46f3c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.054168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f65db341-17fe-4dc4-a064-23bebb46f3c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.054168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f65db341-17fe-4dc4-a064-23bebb46f3c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.054168] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f65db341-17fe-4dc4-a064-23bebb46f3c0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.125912] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb7ecab4-2e5d-45f6-bd1e-ff7674178904 [ 665.126148] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.126148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.126240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.126445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.126445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.127839] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb7ecab4-2e5d-45f6-bd1e-ff7674178904 already deleted. [ 665.127839] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb7ecab4-2e5d-45f6-bd1e-ff7674178904" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.184370] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.184594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.184594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.184877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.184877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.184981] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 already deleted. [ 665.185088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.315518] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.315663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.316332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.316332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.316332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.316332] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 is going to be created. [ 665.391873] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.393253] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.393373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.395887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.396377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.408265] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 in Status: UNINITIALIZED for 2s [ 665.557267] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f65db341-17fe-4dc4-a064-23bebb46f3c0 [ 665.557560] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.558314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.562124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.562491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.562555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.562610] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f65db341-17fe-4dc4-a064-23bebb46f3c0 already deleted. [ 665.562710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f65db341-17fe-4dc4-a064-23bebb46f3c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.767281] env[69656]: INFO networking_nsxv3.common.synchronization [req-301ebee4-47fe-44ea-b05a-c153599c62c8 req-26e12867-aead-4e18-8f6d-430755129cc2 tempest-DeleteServersAdminTestJSON-1062874263 tempest-DeleteServersAdminTestJSON-1062874263-project-member] Enqueued Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_members [ 665.767281] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_members [ 665.767281] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.767281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.768392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.768392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.768392] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.768392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.768392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.768392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.768392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.768392] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.249189] env[69656]: INFO networking_nsxv3.common.synchronization [req-a2cafc07-dd8a-467e-90ff-71ef3299551e req-e87ab78f-541c-4b61-a650-ed97007bed73 service nova] Enqueued Resource ID: 4a133f47-cf05-42f1-8365-6a566b72e14d with Priority: HIGHEST for action security_group_rules [ 666.249415] env[69656]: INFO networking_nsxv3.common.synchronization [req-a2cafc07-dd8a-467e-90ff-71ef3299551e req-e87ab78f-541c-4b61-a650-ed97007bed73 service nova] Enqueued Resource ID: 4a133f47-cf05-42f1-8365-6a566b72e14d with Priority: HIGHEST for action security_group_members [ 666.249504] env[69656]: INFO networking_nsxv3.common.synchronization [req-a2cafc07-dd8a-467e-90ff-71ef3299551e req-e87ab78f-541c-4b61-a650-ed97007bed73 service nova] Enqueued Resource ID: f4a05c40-0c0e-4114-bb61-c91ae2b05472 with Priority: HIGHEST for action port [ 666.250014] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a133f47-cf05-42f1-8365-6a566b72e14d with Priority: HIGHEST for action security_group_rules [ 666.250215] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a133f47-cf05-42f1-8365-6a566b72e14d with Priority: HIGHEST for action security_group_members [ 666.250285] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a05c40-0c0e-4114-bb61-c91ae2b05472 with Priority: HIGHEST for action port [ 666.250531] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a133f47-cf05-42f1-8365-6a566b72e14d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.250661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.250723] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.250989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.251057] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a133f47-cf05-42f1-8365-6a566b72e14d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.251881] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a133f47-cf05-42f1-8365-6a566b72e14d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.252057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.252122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.252390] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.252461] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.252527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.252605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.252722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.252818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.252895] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a133f47-cf05-42f1-8365-6a566b72e14d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.253770] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4a05c40-0c0e-4114-bb61-c91ae2b05472 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.253884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4a05c40-0c0e-4114-bb61-c91ae2b05472" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.253952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4a05c40-0c0e-4114-bb61-c91ae2b05472" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.254217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4a05c40-0c0e-4114-bb61-c91ae2b05472" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.254255] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4a05c40-0c0e-4114-bb61-c91ae2b05472',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.270529] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.270701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.270769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.270975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.271185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.271331] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.271390] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.271427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.271662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.271741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.271825] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb already deleted. [ 666.271911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.756068] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4a05c40-0c0e-4114-bb61-c91ae2b05472 with status ACTIVE [ 666.756675] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.756675] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.756675] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.756848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.757523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.757523] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.757523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.757523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.759016] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.759016] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.759296] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.760765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.760882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.761311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.761443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.761581] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4a05c40-0c0e-4114-bb61-c91ae2b05472 is going to be updated. [ 666.762830] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a133f47-cf05-42f1-8365-6a566b72e14d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.769027] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a133f47-cf05-42f1-8365-6a566b72e14d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.769027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.785294] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.785462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.785503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.786512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.786729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.787175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4a05c40-0c0e-4114-bb61-c91ae2b05472" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.084282] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.084741] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.084868] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.085312] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.085464] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.085618] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.085753] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.086466] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.086684] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.086963] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.089638] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.089638] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.089638] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.089638] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.089638] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.089638] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.106795] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.108311] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 667.108441] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.108863] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.110309] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-66f9f865-73db-442d-becf-eec603b8d672 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.110309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-66f9f865-73db-442d-becf-eec603b8d672" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.110309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-66f9f865-73db-442d-becf-eec603b8d672" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.110309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-66f9f865-73db-442d-becf-eec603b8d672" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.110309] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66f9f865-73db-442d-becf-eec603b8d672',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.238337] env[69656]: INFO networking_nsxv3.common.synchronization [None req-72b4cf71-7af9-44ab-b804-5c166486041f None None] Enqueued Resource ID: 4a64a2e2-306a-4537-940b-cfbedbb19559 with Priority: HIGHEST for action port [ 667.238337] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a64a2e2-306a-4537-940b-cfbedbb19559 with Priority: HIGHEST for action port [ 667.238337] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a64a2e2-306a-4537-940b-cfbedbb19559 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.238337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a64a2e2-306a-4537-940b-cfbedbb19559" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.238337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a64a2e2-306a-4537-940b-cfbedbb19559" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.238337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a64a2e2-306a-4537-940b-cfbedbb19559" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.238337] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a64a2e2-306a-4537-940b-cfbedbb19559',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.270209] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a133f47-cf05-42f1-8365-6a566b72e14d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.419834] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 in Status: SUCCESS [ 667.420147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.420615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.420848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.421112] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.421259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.421290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.421458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.421539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.421625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.421746] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7c27843-e365-4bd4-9103-dc94b0c2a637',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.613143] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.613368] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.613494] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.613784] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.613938] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.614114] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 66f9f865-73db-442d-becf-eec603b8d672 not found, creating... [ 667.614395] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.615235] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.615363] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.616350] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.616521] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.616859] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.617482] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.617606] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.618597] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.618742] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.618911] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 66f9f865-73db-442d-becf-eec603b8d672 is going to be created. [ 667.639496] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.640057] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.640367] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.640644] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.640915] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.642955] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-66f9f865-73db-442d-becf-eec603b8d672" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.743628] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a64a2e2-306a-4537-940b-cfbedbb19559 [ 667.743628] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.743628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.743628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.743628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.743628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.743628] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a64a2e2-306a-4537-940b-cfbedbb19559 already deleted. [ 667.743628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a64a2e2-306a-4537-940b-cfbedbb19559" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.772644] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.772850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.772937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.776218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.776218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.776218] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a133f47-cf05-42f1-8365-6a566b72e14d is going to be created. [ 667.814877] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.814877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.814877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.814877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.818370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.826074] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a133f47-cf05-42f1-8365-6a566b72e14d in Status: UNINITIALIZED for 2s [ 667.925142] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c27843-e365-4bd4-9103-dc94b0c2a637 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.925374] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.925442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.925711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.925820] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.925954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.925954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.926114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.926407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.926407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.926496] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c27843-e365-4bd4-9103-dc94b0c2a637 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.926547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.926607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.926763] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.926895] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.926994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.927074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.927211] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.927282] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.927448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.927448] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7c27843-e365-4bd4-9103-dc94b0c2a637',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.196021] env[69656]: INFO networking_nsxv3.common.synchronization [None req-07d27e4e-8b80-4d0f-9d40-b46fd75165af None None] Enqueued Resource ID: 2df8643f-1327-4409-b9fa-38000d5c45ff with Priority: HIGHEST for action port [ 668.196131] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2df8643f-1327-4409-b9fa-38000d5c45ff with Priority: HIGHEST for action port [ 668.196717] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-2df8643f-1327-4409-b9fa-38000d5c45ff taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.196818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2df8643f-1327-4409-b9fa-38000d5c45ff" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.196887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2df8643f-1327-4409-b9fa-38000d5c45ff" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.200260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2df8643f-1327-4409-b9fa-38000d5c45ff" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.200260] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2df8643f-1327-4409-b9fa-38000d5c45ff',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.246277] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d8119c7d-f898-4537-971f-911ff3d9f999 None None] Enqueued Resource ID: ca1efef7-938c-44ea-9280-130a4b97df4b with Priority: HIGHEST for action port [ 668.246656] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1efef7-938c-44ea-9280-130a4b97df4b with Priority: HIGHEST for action port [ 668.246980] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca1efef7-938c-44ea-9280-130a4b97df4b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.248977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca1efef7-938c-44ea-9280-130a4b97df4b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.248977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca1efef7-938c-44ea-9280-130a4b97df4b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.249340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca1efef7-938c-44ea-9280-130a4b97df4b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.249340] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca1efef7-938c-44ea-9280-130a4b97df4b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.437644] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7c27843-e365-4bd4-9103-dc94b0c2a637: rpc.has_security_group_logging(os_id): False [ 668.458934] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.458934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.459879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.460286] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.462619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.462619] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.462619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.462619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.462619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.462619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.462619] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.462619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.462619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.462619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.462619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.462619] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.462619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.462619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.463389] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.463389] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.463389] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 is going to be created. [ 668.541104] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.541287] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.541374] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.541617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.541823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.555786] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 in Status: IN_PROGRESS for 2s [ 668.704595] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2df8643f-1327-4409-b9fa-38000d5c45ff [ 668.704595] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.704595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.704595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.704812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.704919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.705025] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2df8643f-1327-4409-b9fa-38000d5c45ff already deleted. [ 668.705125] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2df8643f-1327-4409-b9fa-38000d5c45ff" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.751956] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca1efef7-938c-44ea-9280-130a4b97df4b [ 668.752212] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.753473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.753473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.753473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.753473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.753473] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca1efef7-938c-44ea-9280-130a4b97df4b already deleted. [ 668.753473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca1efef7-938c-44ea-9280-130a4b97df4b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.629461] env[69656]: INFO networking_nsxv3.common.synchronization [req-301ebee4-47fe-44ea-b05a-c153599c62c8 req-65cad95f-93c7-47e4-9178-d64e065c87cd service nova] Enqueued Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_rules [ 669.630155] env[69656]: INFO networking_nsxv3.common.synchronization [req-301ebee4-47fe-44ea-b05a-c153599c62c8 req-65cad95f-93c7-47e4-9178-d64e065c87cd service nova] Enqueued Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_members [ 669.630155] env[69656]: INFO networking_nsxv3.common.synchronization [req-301ebee4-47fe-44ea-b05a-c153599c62c8 req-65cad95f-93c7-47e4-9178-d64e065c87cd service nova] Enqueued Resource ID: 66f9f865-73db-442d-becf-eec603b8d672 with Priority: HIGHEST for action port [ 669.631307] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_rules [ 669.631307] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_members [ 669.631307] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f9f865-73db-442d-becf-eec603b8d672 with Priority: HIGHEST for action port [ 669.631307] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.631307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.631307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.632898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.632980] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.634254] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.634366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.634457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.634668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.635468] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.635468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.635468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.635468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.635468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.635468] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.637399] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-66f9f865-73db-442d-becf-eec603b8d672 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.637591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66f9f865-73db-442d-becf-eec603b8d672" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.637680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66f9f865-73db-442d-becf-eec603b8d672" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.637875] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66f9f865-73db-442d-becf-eec603b8d672" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.638022] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66f9f865-73db-442d-becf-eec603b8d672',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.840937] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a133f47-cf05-42f1-8365-6a566b72e14d in Status: SUCCESS [ 669.841216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.841435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.842055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.842358] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.842557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.842652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.842834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.842930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.843052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.843152] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a133f47-cf05-42f1-8365-6a566b72e14d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.855814] env[69656]: INFO networking_nsxv3.common.synchronization [req-887f03f1-2990-436a-87eb-ebf66a94798e req-87706b09-1faf-4a53-b039-58364fdaaf36 tempest-MigrationsAdminTest-978699219 tempest-MigrationsAdminTest-978699219-project-member] Enqueued Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_members [ 669.855861] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_members [ 669.856157] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.856287] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.856351] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.856593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.856743] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.863041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.863041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.863041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.863041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.863041] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.142090] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.142237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.142437] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.143328] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66f9f865-73db-442d-becf-eec603b8d672 with status ACTIVE [ 670.143835] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.143835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.143835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.144509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.144509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.144509] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.144509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.144509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.144509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.144509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.144785] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.144785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.144856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.145492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.145646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.146634] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66f9f865-73db-442d-becf-eec603b8d672 is going to be updated. [ 670.167030] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.167030] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.167030] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.169586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.169586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.169586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66f9f865-73db-442d-becf-eec603b8d672" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.192609] env[69656]: INFO networking_nsxv3.common.synchronization [None req-49a34582-3811-4eae-8338-a17517532233 None None] Enqueued Resource ID: 075cc4d0-581d-466a-87b0-b40617c4d2c1 with Priority: HIGHEST for action port [ 670.192944] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 075cc4d0-581d-466a-87b0-b40617c4d2c1 with Priority: HIGHEST for action port [ 670.196994] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-075cc4d0-581d-466a-87b0-b40617c4d2c1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.197176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-075cc4d0-581d-466a-87b0-b40617c4d2c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.197356] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-075cc4d0-581d-466a-87b0-b40617c4d2c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.197517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-075cc4d0-581d-466a-87b0-b40617c4d2c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.197600] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('075cc4d0-581d-466a-87b0-b40617c4d2c1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.311866] env[69656]: INFO networking_nsxv3.common.synchronization [None req-7a9faf00-ae7d-40d6-808a-0ac014e4996d None None] Enqueued Resource ID: 6b54be70-e3bd-4ea5-8186-f7ad0c4f39b4 with Priority: HIGHEST for action port [ 670.312495] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b54be70-e3bd-4ea5-8186-f7ad0c4f39b4 with Priority: HIGHEST for action port [ 670.312753] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b54be70-e3bd-4ea5-8186-f7ad0c4f39b4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.312888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b54be70-e3bd-4ea5-8186-f7ad0c4f39b4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.312954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b54be70-e3bd-4ea5-8186-f7ad0c4f39b4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.314188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b54be70-e3bd-4ea5-8186-f7ad0c4f39b4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.314188] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b54be70-e3bd-4ea5-8186-f7ad0c4f39b4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.351075] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a133f47-cf05-42f1-8365-6a566b72e14d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.351075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.351075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.351075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.351287] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.351392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.351422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.351565] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.351912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.351912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.351912] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a133f47-cf05-42f1-8365-6a566b72e14d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.352097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.352097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.352367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.352367] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.352517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.352517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.356130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.356130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.356130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.356130] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a133f47-cf05-42f1-8365-6a566b72e14d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.363628] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.364535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.364535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.364535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.364535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.364720] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.365665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.365665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.365665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.365665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.365665] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 792b043f-2560-4918-890f-99f50b059db4 already deleted. [ 670.365665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.431421] env[69656]: INFO networking_nsxv3.common.synchronization [None req-4d4c2a87-f128-44de-b125-88eb1947c5b7 tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_rules [ 670.431421] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_rules [ 670.431421] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3521005-0bf3-4791-8930-fe6bb6c94423 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.431421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.431421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.431421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.431421] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.567037] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 in Status: SUCCESS [ 670.567771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.651221] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.683335] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.683335] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.683335] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.683335] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.683335] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.683335] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.683335] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.683335] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.683335] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.683649] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.683779] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.683951] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.684126] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.684275] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.684414] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.684578] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.700414] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 075cc4d0-581d-466a-87b0-b40617c4d2c1 [ 670.700414] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.700604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.700709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.701245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.701821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.702356] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:075cc4d0-581d-466a-87b0-b40617c4d2c1 already deleted. [ 670.702356] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-075cc4d0-581d-466a-87b0-b40617c4d2c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.706155] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.706155] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 670.706155] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.706155] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.708976] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-ed383ceb-7816-4a6d-bbf3-319c06c24d05 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.708976] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-ed383ceb-7816-4a6d-bbf3-319c06c24d05" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.709310] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-ed383ceb-7816-4a6d-bbf3-319c06c24d05" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.710034] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-ed383ceb-7816-4a6d-bbf3-319c06c24d05" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.711498] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed383ceb-7816-4a6d-bbf3-319c06c24d05',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.753132] env[69656]: INFO networking_nsxv3.common.synchronization [None req-28ea5879-aeca-4e00-b870-1cf02578853f tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_rules [ 670.753278] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_rules [ 670.753623] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3521005-0bf3-4791-8930-fe6bb6c94423 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.753765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.819114] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b54be70-e3bd-4ea5-8186-f7ad0c4f39b4 [ 670.819114] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.819114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.819114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.819114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.819114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.819114] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b54be70-e3bd-4ea5-8186-f7ad0c4f39b4 already deleted. [ 670.819114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b54be70-e3bd-4ea5-8186-f7ad0c4f39b4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.858478] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a133f47-cf05-42f1-8365-6a566b72e14d: rpc.has_security_group_logging(os_id): False [ 670.877158] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.877361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.877564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.880936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.880936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.880936] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.880936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.880936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.880936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.880936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.880936] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.880936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.880936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.880936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.880936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.880936] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.880936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.881540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.881540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.881540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.881540] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a133f47-cf05-42f1-8365-6a566b72e14d is going to be created. [ 671.043269] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.043269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.043269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.043269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.043269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.062667] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a133f47-cf05-42f1-8365-6a566b72e14d in Status: IN_PROGRESS for 2s [ 671.078750] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.078750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.078750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.078750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.078750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.078750] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3521005-0bf3-4791-8930-fe6bb6c94423 already deleted. [ 671.078750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.078750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.078750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.078750] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.153080] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.153257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.153332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.155417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.155417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.155417] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb is going to be created. [ 671.176547] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.176547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.176547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.176547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.176547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.188444] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: UNINITIALIZED for 2s [ 671.217661] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.217942] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.218576] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.218883] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.219063] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.219230] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port ed383ceb-7816-4a6d-bbf3-319c06c24d05 not found, creating... [ 671.219508] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.219672] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.219787] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.220024] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.220228] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.220530] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.220684] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.222868] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.223310] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.223474] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.223656] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: ed383ceb-7816-4a6d-bbf3-319c06c24d05 is going to be created. [ 671.246098] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.247371] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.247371] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.248520] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.248855] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.249135] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-ed383ceb-7816-4a6d-bbf3-319c06c24d05" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.539652] env[69656]: INFO networking_nsxv3.common.synchronization [None req-7cf57ee7-c813-4ca6-89e1-6ad640fabb5c None None] Enqueued Resource ID: ce377ade-e69b-4412-b7ff-befffe9a87c5 with Priority: HIGHEST for action port [ 671.539918] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce377ade-e69b-4412-b7ff-befffe9a87c5 with Priority: HIGHEST for action port [ 671.540959] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce377ade-e69b-4412-b7ff-befffe9a87c5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.540959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce377ade-e69b-4412-b7ff-befffe9a87c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.540959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce377ade-e69b-4412-b7ff-befffe9a87c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.541914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce377ade-e69b-4412-b7ff-befffe9a87c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.541914] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce377ade-e69b-4412-b7ff-befffe9a87c5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.608172] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.608355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.608421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.610733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.610733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.610733] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3521005-0bf3-4791-8930-fe6bb6c94423 already deleted. [ 671.610733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.048790] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce377ade-e69b-4412-b7ff-befffe9a87c5 [ 672.051111] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.051111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.051111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.051111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.051111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.051111] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce377ade-e69b-4412-b7ff-befffe9a87c5 already deleted. [ 672.051111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce377ade-e69b-4412-b7ff-befffe9a87c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.103713] env[69656]: INFO networking_nsxv3.common.synchronization [req-887f03f1-2990-436a-87eb-ebf66a94798e req-963594e2-63ee-4e09-b94a-17288cd8a1c0 service nova] Enqueued Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_rules [ 672.103713] env[69656]: INFO networking_nsxv3.common.synchronization [req-887f03f1-2990-436a-87eb-ebf66a94798e req-963594e2-63ee-4e09-b94a-17288cd8a1c0 service nova] Enqueued Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_members [ 672.103713] env[69656]: INFO networking_nsxv3.common.synchronization [req-887f03f1-2990-436a-87eb-ebf66a94798e req-963594e2-63ee-4e09-b94a-17288cd8a1c0 service nova] Enqueued Resource ID: ed383ceb-7816-4a6d-bbf3-319c06c24d05 with Priority: HIGHEST for action port [ 672.107268] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_rules [ 672.107268] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_members [ 672.107268] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed383ceb-7816-4a6d-bbf3-319c06c24d05 with Priority: HIGHEST for action port [ 672.107268] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.107268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.107268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.107268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.107268] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.108114] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.108372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.108979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.108979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.108979] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.108979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.108979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.109219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.109249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.109324] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.110460] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed383ceb-7816-4a6d-bbf3-319c06c24d05 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.110595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed383ceb-7816-4a6d-bbf3-319c06c24d05" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.110684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed383ceb-7816-4a6d-bbf3-319c06c24d05" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.110864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed383ceb-7816-4a6d-bbf3-319c06c24d05" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.110924] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed383ceb-7816-4a6d-bbf3-319c06c24d05',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.422510] env[69656]: INFO networking_nsxv3.common.synchronization [None req-50ce24ab-da50-4f40-a790-ac9192804dc8 None None] Enqueued Resource ID: abcd6192-5901-41ca-8479-9e5c361ed149 with Priority: HIGHEST for action port [ 672.422757] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abcd6192-5901-41ca-8479-9e5c361ed149 with Priority: HIGHEST for action port [ 672.423293] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-abcd6192-5901-41ca-8479-9e5c361ed149 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.423414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abcd6192-5901-41ca-8479-9e5c361ed149" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.423496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abcd6192-5901-41ca-8479-9e5c361ed149" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.423787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abcd6192-5901-41ca-8479-9e5c361ed149" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.424087] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abcd6192-5901-41ca-8479-9e5c361ed149',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.612410] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.614374] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.614478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.616079] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed383ceb-7816-4a6d-bbf3-319c06c24d05 with status ACTIVE [ 672.616079] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.616079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.616079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.616079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.616079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.616079] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.616079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.616079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.616457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.616457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.616508] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.616796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.616796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.616796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.617021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.617021] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed383ceb-7816-4a6d-bbf3-319c06c24d05 is going to be updated. [ 672.638720] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.638870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.638941] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.639170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.639294] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.639452] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed383ceb-7816-4a6d-bbf3-319c06c24d05" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.928693] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abcd6192-5901-41ca-8479-9e5c361ed149 [ 672.928693] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.928930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.928930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.929293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.929463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.929783] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abcd6192-5901-41ca-8479-9e5c361ed149 already deleted. [ 672.930058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abcd6192-5901-41ca-8479-9e5c361ed149" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.079126] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a133f47-cf05-42f1-8365-6a566b72e14d in Status: SUCCESS [ 673.080407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.115468] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.197737] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: SUCCESS [ 673.197737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.197737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.197737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.197737] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.197737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.197737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.197737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.197737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.197737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.197737] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.622588] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.622588] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.622588] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.622588] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.622588] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.622588] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 792b043f-2560-4918-890f-99f50b059db4 is going to be created. [ 673.636038] env[69656]: INFO networking_nsxv3.common.synchronization [None req-9a484b19-1ded-4dcd-9b75-c5b0eb01ae88 None None] Enqueued Resource ID: 7d1a2463-57a8-4e4c-976a-254e1f3169c8 with Priority: HIGHEST for action port [ 673.636038] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d1a2463-57a8-4e4c-976a-254e1f3169c8 with Priority: HIGHEST for action port [ 673.636038] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d1a2463-57a8-4e4c-976a-254e1f3169c8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.636595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d1a2463-57a8-4e4c-976a-254e1f3169c8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.636798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d1a2463-57a8-4e4c-976a-254e1f3169c8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.637214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d1a2463-57a8-4e4c-976a-254e1f3169c8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.637388] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d1a2463-57a8-4e4c-976a-254e1f3169c8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.646252] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.646252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.646252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.646252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.646252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.652674] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: UNINITIALIZED for 2s [ 673.702840] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.706021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.706021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.706021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.706021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.706717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.706717] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.899326] env[69656]: INFO networking_nsxv3.common.synchronization [req-5a99d5d8-0c84-403f-8a59-f06aef1686f3 req-f73f43fb-5396-41ee-ba79-a8fc2497f4c8 tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGHEST for action security_group_members [ 673.899326] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGHEST for action security_group_members [ 673.899326] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a33f9cc8-ecf3-4437-910b-83546eec0eb5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.899326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.899326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.899326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.900701] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.901042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.901204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.901468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.901985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.902245] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.139892] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d1a2463-57a8-4e4c-976a-254e1f3169c8 [ 674.140171] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.140319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.140386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.140605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.140694] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.140786] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d1a2463-57a8-4e4c-976a-254e1f3169c8 already deleted. [ 674.140868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d1a2463-57a8-4e4c-976a-254e1f3169c8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.212240] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb: rpc.has_security_group_logging(os_id): False [ 674.230959] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.231171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.231465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.231465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.231590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.231742] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.231842] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.231900] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.232076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.232162] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.232465] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.232581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.232636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.232778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.232849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.233216] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.233412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.233482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.233638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.233716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.233800] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb is going to be created. [ 674.298690] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.298792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.298792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.299068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.299325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.312932] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: IN_PROGRESS for 2s [ 674.406215] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.406617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.406732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.407088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.407250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.407468] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.407593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.407661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.407835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.408024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.408127] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 already deleted. [ 674.408215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.613182] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-855 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.613182] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-855" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.613182] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-855" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.613182] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-855" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.613182] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.613182] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.613182] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.615780] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.616209] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.616612] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.619333] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.619333] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.619333] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.619333] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.619333] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.619333] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.637179] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f22cc48f-7949-408f-857e-43493183cb81 tempest-ServersWithSpecificFlavorTestJSON-7449257 tempest-ServersWithSpecificFlavorTestJSON-7449257-project-member] Enqueued Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_rules [ 674.637844] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_rules [ 674.639573] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.639782] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.640021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.640789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.640789] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.647250] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.647480] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 674.647620] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.647891] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-855" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.648302] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-8db95fcb-3f73-4bd3-a9b6-951f1ff294cf taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.648464] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-8db95fcb-3f73-4bd3-a9b6-951f1ff294cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.648635] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-8db95fcb-3f73-4bd3-a9b6-951f1ff294cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.648894] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-8db95fcb-3f73-4bd3-a9b6-951f1ff294cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.649037] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8db95fcb-3f73-4bd3-a9b6-951f1ff294cf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.842708] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f215f3b5-8e42-42f1-8bda-9e83361134af tempest-ServersWithSpecificFlavorTestJSON-7449257 tempest-ServersWithSpecificFlavorTestJSON-7449257-project-member] Enqueued Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_rules [ 674.843254] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_rules [ 674.843989] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.843989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.156311] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.156700] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.156700] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.156949] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.157115] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.157274] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 8db95fcb-3f73-4bd3-a9b6-951f1ff294cf not found, creating... [ 675.157690] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.157690] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.157928] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.158160] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.158270] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.158515] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.158632] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.163755] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.163755] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.163755] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.163755] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 8db95fcb-3f73-4bd3-a9b6-951f1ff294cf is going to be created. [ 675.163755] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.163755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.163755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.163755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.163755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.163755] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 already deleted. [ 675.163755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.166043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.166043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.166043] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.181168] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.181459] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.181583] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.181963] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.182171] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.182335] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-8db95fcb-3f73-4bd3-a9b6-951f1ff294cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.432936] env[69656]: INFO networking_nsxv3.common.synchronization [None req-7ef87890-b9c4-4651-bfc9-01170a61684b tempest-ServersV294TestFqdnHostnames-1402798877 tempest-ServersV294TestFqdnHostnames-1402798877-project-member] Enqueued Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGHEST for action security_group_rules [ 675.433875] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGHEST for action security_group_rules [ 675.438386] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e79ef0da-74c8-48fe-99d7-25b720dd4847 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.438524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.438591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.438855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.438962] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.648701] env[69656]: INFO networking_nsxv3.common.synchronization [None req-2a1bb4e8-23b4-40da-a3fd-69daf787cdef tempest-ServersV294TestFqdnHostnames-1402798877 tempest-ServersV294TestFqdnHostnames-1402798877-project-member] Enqueued Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGHEST for action security_group_rules [ 675.649312] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGHEST for action security_group_rules [ 675.649607] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e79ef0da-74c8-48fe-99d7-25b720dd4847 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.649711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.663407] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: SUCCESS [ 675.663619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.663765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.663975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.664174] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.664305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.664384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.664552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.664634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.664724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.664814] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.681721] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.681721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.681867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.681974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.682077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.682188] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 already deleted. [ 675.682246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.962768] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.962768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.963430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.963430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.963430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.963430] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 already deleted. [ 675.963430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.963606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.963748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.963829] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.170905] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.170905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.170905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.170905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.170905] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.170905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.170905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.170905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.170905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.170905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.170905] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.170905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.170905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.170905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.170905] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.170905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.171759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.171759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.171759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.171759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.171759] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.324158] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: SUCCESS [ 676.325747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.483845] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.483845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.483845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.483845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.483845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.483845] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 already deleted. [ 676.483845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.577989] env[69656]: INFO networking_nsxv3.common.synchronization [req-5a99d5d8-0c84-403f-8a59-f06aef1686f3 req-12e545ae-b9ec-4034-9183-c5363ea77f8d service nova] Enqueued Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGHEST for action security_group_rules [ 676.577989] env[69656]: INFO networking_nsxv3.common.synchronization [req-5a99d5d8-0c84-403f-8a59-f06aef1686f3 req-12e545ae-b9ec-4034-9183-c5363ea77f8d service nova] Enqueued Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGHEST for action security_group_members [ 676.577989] env[69656]: INFO networking_nsxv3.common.synchronization [req-5a99d5d8-0c84-403f-8a59-f06aef1686f3 req-12e545ae-b9ec-4034-9183-c5363ea77f8d service nova] Enqueued Resource ID: 8db95fcb-3f73-4bd3-a9b6-951f1ff294cf with Priority: HIGHEST for action port [ 676.578188] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGHEST for action security_group_rules [ 676.578287] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGHEST for action security_group_members [ 676.578393] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8db95fcb-3f73-4bd3-a9b6-951f1ff294cf with Priority: HIGHEST for action port [ 676.578662] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.578798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.578867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.580054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.580054] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.583043] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a33f9cc8-ecf3-4437-910b-83546eec0eb5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.583043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.583148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.583594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.586468] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.586468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.586468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.586468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.586468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.586468] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.586899] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-8db95fcb-3f73-4bd3-a9b6-951f1ff294cf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.587029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8db95fcb-3f73-4bd3-a9b6-951f1ff294cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.587098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8db95fcb-3f73-4bd3-a9b6-951f1ff294cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.587283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8db95fcb-3f73-4bd3-a9b6-951f1ff294cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.587358] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8db95fcb-3f73-4bd3-a9b6-951f1ff294cf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.674353] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 792b043f-2560-4918-890f-99f50b059db4: rpc.has_security_group_logging(os_id): False [ 676.692410] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.692410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.692410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.692629] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.693301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.693301] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.693301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.693301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.693510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.693510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.693573] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.693682] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.693748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.693887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.693976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.696704] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.697074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.697179] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.697866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.697866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.697866] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 792b043f-2560-4918-890f-99f50b059db4 is going to be created. [ 676.780700] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.780922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.781086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.781259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.781367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.792631] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: IN_PROGRESS for 2s [ 677.089281] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a33f9cc8-ecf3-4437-910b-83546eec0eb5 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.089470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.089761] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.090866] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8db95fcb-3f73-4bd3-a9b6-951f1ff294cf with status ACTIVE [ 677.091214] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.091287] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.091399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.092159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.092159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.092159] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.095098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.095098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.096444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.096444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.096444] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.096444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.096444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.096444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.096444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.096776] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8db95fcb-3f73-4bd3-a9b6-951f1ff294cf is going to be updated. [ 677.117723] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.117970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.118131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.118413] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.118552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.118731] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8db95fcb-3f73-4bd3-a9b6-951f1ff294cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.469884] env[69656]: INFO networking_nsxv3.common.synchronization [None req-45cef084-95c4-4edc-bc39-26e0ac34eb8d None None] Enqueued Resource ID: ddc54d96-0118-4958-b62b-612eb4b356ba with Priority: HIGHEST for action port [ 677.470186] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddc54d96-0118-4958-b62b-612eb4b356ba with Priority: HIGHEST for action port [ 677.470612] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddc54d96-0118-4958-b62b-612eb4b356ba taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.470745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddc54d96-0118-4958-b62b-612eb4b356ba" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.471320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddc54d96-0118-4958-b62b-612eb4b356ba" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.472480] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddc54d96-0118-4958-b62b-612eb4b356ba" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.472480] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddc54d96-0118-4958-b62b-612eb4b356ba',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.599035] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.975988] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddc54d96-0118-4958-b62b-612eb4b356ba [ 677.975988] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.975988] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.975988] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.976966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.977153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.977980] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddc54d96-0118-4958-b62b-612eb4b356ba already deleted. [ 677.978124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddc54d96-0118-4958-b62b-612eb4b356ba" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.103651] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.103651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.103651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.103651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.103651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.103651] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 is going to be created. [ 678.129360] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.129360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.129360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.129360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.129682] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.139645] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 in Status: UNINITIALIZED for 2s [ 678.805010] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: SUCCESS [ 678.805347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.806846] env[69656]: INFO networking_nsxv3.common.synchronization [None req-2c435f2c-d64a-495f-b426-043741ed537f None None] Enqueued Resource ID: 579befe8-4952-4784-826c-08a447ccfdc2 with Priority: HIGHEST for action port [ 679.807215] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579befe8-4952-4784-826c-08a447ccfdc2 with Priority: HIGHEST for action port [ 679.808031] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-579befe8-4952-4784-826c-08a447ccfdc2 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.808031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-579befe8-4952-4784-826c-08a447ccfdc2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.809872] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-579befe8-4952-4784-826c-08a447ccfdc2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.811249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-579befe8-4952-4784-826c-08a447ccfdc2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.811329] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('579befe8-4952-4784-826c-08a447ccfdc2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.148309] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 in Status: SUCCESS [ 680.148641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.148811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.149096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.149596] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.150094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.150201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.150530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.151621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.151756] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.151856] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.315101] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 579befe8-4952-4784-826c-08a447ccfdc2 [ 680.315348] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.315487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.315551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.315776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.315886] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.316041] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:579befe8-4952-4784-826c-08a447ccfdc2 already deleted. [ 680.316103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-579befe8-4952-4784-826c-08a447ccfdc2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.654460] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.157581] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a33f9cc8-ecf3-4437-910b-83546eec0eb5: rpc.has_security_group_logging(os_id): False [ 681.176597] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.176718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.177027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.178216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.178216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.178216] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.178216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.178216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.178216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.178216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.178216] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 is going to be created. [ 681.248580] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.248580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.248580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.248580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.248580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.259785] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 in Status: IN_PROGRESS for 2s [ 681.722144] env[69656]: INFO networking_nsxv3.common.synchronization [req-bd83bab5-f9fd-4f3e-9079-4f62506f56da req-7f3814b9-8600-4b04-a771-c2f7d9d225a6 tempest-ServerDiagnosticsTest-735963863 tempest-ServerDiagnosticsTest-735963863-project-member] Enqueued Resource ID: c36721c6-8615-4066-ad71-7555325052c1 with Priority: HIGHEST for action security_group_members [ 681.722930] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c36721c6-8615-4066-ad71-7555325052c1 with Priority: HIGHEST for action security_group_members [ 681.723100] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c36721c6-8615-4066-ad71-7555325052c1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.723707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.723784] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.724070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.724286] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.724408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.724475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.724643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.724735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.724832] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c36721c6-8615-4066-ad71-7555325052c1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.227436] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.227733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.227733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.227871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.227959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.228202] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.228332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.228371] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.228510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.228688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.228688] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c36721c6-8615-4066-ad71-7555325052c1 already deleted. [ 682.228815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.528309] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.528309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.528309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.528542] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.528846] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.529019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.532037] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.532713] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.532892] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.533125] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.533425] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.534144] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.534222] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.535191] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.535191] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.535646] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.555515] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.555627] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.555766] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.555988] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.556292] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-ce81eadd-302d-460f-bfcc-560f43828a9f taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.556509] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-ce81eadd-302d-460f-bfcc-560f43828a9f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.556589] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-ce81eadd-302d-460f-bfcc-560f43828a9f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.556939] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-ce81eadd-302d-460f-bfcc-560f43828a9f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.557096] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce81eadd-302d-460f-bfcc-560f43828a9f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.064821] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.064821] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.064821] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.064821] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.064821] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.064821] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port ce81eadd-302d-460f-bfcc-560f43828a9f not found, creating... [ 683.064821] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.064821] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.064821] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.064821] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.064821] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.065547] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.065547] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.065547] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.065547] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.065547] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.065547] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: ce81eadd-302d-460f-bfcc-560f43828a9f is going to be created. [ 683.086536] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.086763] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.086763] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.087566] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.088043] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.088358] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-ce81eadd-302d-460f-bfcc-560f43828a9f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.273166] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 in Status: SUCCESS [ 683.273166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.348176] env[69656]: INFO networking_nsxv3.common.synchronization [None req-b07e8698-9c77-4c26-bc4b-a5f03ec1e746 None None] Enqueued Resource ID: fb24fb5f-90d5-443c-ac9f-4e42ede2dee8 with Priority: HIGHEST for action port [ 683.348176] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb24fb5f-90d5-443c-ac9f-4e42ede2dee8 with Priority: HIGHEST for action port [ 683.348176] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb24fb5f-90d5-443c-ac9f-4e42ede2dee8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.348176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb24fb5f-90d5-443c-ac9f-4e42ede2dee8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.349122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb24fb5f-90d5-443c-ac9f-4e42ede2dee8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.349122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb24fb5f-90d5-443c-ac9f-4e42ede2dee8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.349278] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb24fb5f-90d5-443c-ac9f-4e42ede2dee8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.853385] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb24fb5f-90d5-443c-ac9f-4e42ede2dee8 [ 683.853705] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.853897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.854496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.854496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.854496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.854496] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb24fb5f-90d5-443c-ac9f-4e42ede2dee8 already deleted. [ 683.854856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb24fb5f-90d5-443c-ac9f-4e42ede2dee8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.073635] env[69656]: INFO networking_nsxv3.common.synchronization [req-4fd510d4-8487-4394-951a-70e69c0256dd req-cf14ff26-20c4-40f3-bbc2-cd4264c83ca0 tempest-FloatingIPsAssociationTestJSON-1340927557 tempest-FloatingIPsAssociationTestJSON-1340927557-project-member] Enqueued Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_members [ 684.084560] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_members [ 684.085123] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.085355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.085355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.085628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.085810] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.085920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.085962] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.086171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.086258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.086356] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.228227] env[69656]: INFO networking_nsxv3.common.synchronization [req-bd83bab5-f9fd-4f3e-9079-4f62506f56da req-11f2ae02-3a55-4864-af45-325bcf148c18 service nova] Enqueued Resource ID: c36721c6-8615-4066-ad71-7555325052c1 with Priority: HIGHEST for action security_group_rules [ 684.228227] env[69656]: INFO networking_nsxv3.common.synchronization [req-bd83bab5-f9fd-4f3e-9079-4f62506f56da req-11f2ae02-3a55-4864-af45-325bcf148c18 service nova] Enqueued Resource ID: c36721c6-8615-4066-ad71-7555325052c1 with Priority: HIGHEST for action security_group_members [ 684.228227] env[69656]: INFO networking_nsxv3.common.synchronization [req-bd83bab5-f9fd-4f3e-9079-4f62506f56da req-11f2ae02-3a55-4864-af45-325bcf148c18 service nova] Enqueued Resource ID: ce81eadd-302d-460f-bfcc-560f43828a9f with Priority: HIGHEST for action port [ 684.229346] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c36721c6-8615-4066-ad71-7555325052c1 with Priority: HIGHEST for action security_group_rules [ 684.232613] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c36721c6-8615-4066-ad71-7555325052c1 with Priority: HIGHEST for action security_group_members [ 684.232613] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce81eadd-302d-460f-bfcc-560f43828a9f with Priority: HIGHEST for action port [ 684.232613] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c36721c6-8615-4066-ad71-7555325052c1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.232613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.232613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.232613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.232613] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c36721c6-8615-4066-ad71-7555325052c1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.232613] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c36721c6-8615-4066-ad71-7555325052c1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.232613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.232613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.232613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.232613] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.232613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.232613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.232613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.232613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.232613] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c36721c6-8615-4066-ad71-7555325052c1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.234631] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce81eadd-302d-460f-bfcc-560f43828a9f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.234912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce81eadd-302d-460f-bfcc-560f43828a9f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.235099] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce81eadd-302d-460f-bfcc-560f43828a9f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.235441] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce81eadd-302d-460f-bfcc-560f43828a9f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.235626] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce81eadd-302d-460f-bfcc-560f43828a9f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.592334] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.592634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.592634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.592794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.593305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.593305] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.593305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.593305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.594093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.594093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.594093] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97579684-a77f-4bf3-9586-742120a2eca4 already deleted. [ 684.594093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.737876] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c36721c6-8615-4066-ad71-7555325052c1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.738057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.738234] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c36721c6-8615-4066-ad71-7555325052c1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.739292] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce81eadd-302d-460f-bfcc-560f43828a9f with status ACTIVE [ 684.739440] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.739544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.739705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.739838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.739948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.740144] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.740235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.740298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.740460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.740531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.740715] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.740802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.740856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.740996] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.742879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.742879] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce81eadd-302d-460f-bfcc-560f43828a9f is going to be updated. [ 684.763414] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.763578] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.763678] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.763896] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.764073] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.764231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce81eadd-302d-460f-bfcc-560f43828a9f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.116017] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-524 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.116017] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-524" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.116017] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-524" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.116302] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-524" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.116425] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.116620] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.116710] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.116973] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.117466] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.118264] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.118264] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.118264] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.118264] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.118488] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.118488] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.119191] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.141247] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.141467] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 685.141651] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.141873] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-524" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.142238] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-e8402221-e598-4782-bf0a-5b5f56558e7b taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.142459] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-e8402221-e598-4782-bf0a-5b5f56558e7b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.143101] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-e8402221-e598-4782-bf0a-5b5f56558e7b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.143101] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-e8402221-e598-4782-bf0a-5b5f56558e7b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.143464] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8402221-e598-4782-bf0a-5b5f56558e7b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.245566] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c36721c6-8615-4066-ad71-7555325052c1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.646651] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.646984] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.646984] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.647594] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.647594] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.647594] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port e8402221-e598-4782-bf0a-5b5f56558e7b not found, creating... [ 685.647820] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.648195] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.648195] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.648366] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.648507] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.648992] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.648992] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.649154] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.649839] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.649839] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.649839] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: e8402221-e598-4782-bf0a-5b5f56558e7b is going to be created. [ 685.669260] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.670356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.670356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.670356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.670356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.670356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-e8402221-e598-4782-bf0a-5b5f56558e7b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.747494] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.747654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.747726] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.747989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.748106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.748219] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c36721c6-8615-4066-ad71-7555325052c1 is going to be created. [ 685.773271] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.773425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.773522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.774041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.774218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.786038] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c36721c6-8615-4066-ad71-7555325052c1 in Status: UNINITIALIZED for 2s [ 685.976908] env[69656]: INFO networking_nsxv3.common.synchronization [req-7485053b-e929-4fe8-bf92-eb01d597b2cc req-e6c788bf-6acb-4f4e-af79-db57f5652507 tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_members [ 685.977660] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_members [ 685.978827] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3521005-0bf3-4791-8930-fe6bb6c94423 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.978982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.979086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.979371] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.979575] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.979696] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.979771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.979931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.980033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.980506] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.017874] env[69656]: INFO networking_nsxv3.common.synchronization [None req-bd4762e5-967a-46f0-9161-d21fb23e5e70 None None] Enqueued Resource ID: 335870a5-67bf-4c67-b03b-ac5ad49dfb6c with Priority: HIGHEST for action port [ 686.018618] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335870a5-67bf-4c67-b03b-ac5ad49dfb6c with Priority: HIGHEST for action port [ 686.018882] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-335870a5-67bf-4c67-b03b-ac5ad49dfb6c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.018985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-335870a5-67bf-4c67-b03b-ac5ad49dfb6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.019050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-335870a5-67bf-4c67-b03b-ac5ad49dfb6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.020223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-335870a5-67bf-4c67-b03b-ac5ad49dfb6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.020316] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('335870a5-67bf-4c67-b03b-ac5ad49dfb6c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.484451] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.484648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.484730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.484999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.484999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.485224] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.485320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.485382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.485536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.485617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.486135] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3521005-0bf3-4791-8930-fe6bb6c94423 already deleted. [ 686.486135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.523303] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 335870a5-67bf-4c67-b03b-ac5ad49dfb6c [ 686.523540] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.523761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.524466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.524646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.524761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.524878] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:335870a5-67bf-4c67-b03b-ac5ad49dfb6c already deleted. [ 686.525115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-335870a5-67bf-4c67-b03b-ac5ad49dfb6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.658184] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.658184] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.658184] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.658560] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.659386] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.659617] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.659686] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.659932] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.660089] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.660428] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.660571] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.660694] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.665138] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.665238] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.665390] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.665553] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.688789] env[69656]: INFO networking_nsxv3.common.synchronization [req-0e50e7c7-ab67-416f-ae95-bb8c5c0a7e01 req-697b7222-f564-41e1-b8bc-324e98487a4a tempest-DeleteServersAdminTestJSON-898071977 tempest-DeleteServersAdminTestJSON-898071977-project-admin] Enqueued Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_members [ 686.689056] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_members [ 686.689335] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.691079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.691079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.691079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.691079] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.691079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.691079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.691079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.691079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.691432] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.693437] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.693660] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 686.693915] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.694257] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.694668] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-a76837b3-8de3-4fe2-809d-081fe43ac642 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.694873] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-a76837b3-8de3-4fe2-809d-081fe43ac642" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.694994] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-a76837b3-8de3-4fe2-809d-081fe43ac642" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.695430] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-a76837b3-8de3-4fe2-809d-081fe43ac642" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.695844] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a76837b3-8de3-4fe2-809d-081fe43ac642',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.914098] env[69656]: INFO networking_nsxv3.common.synchronization [None req-6a04b9a7-aa62-4c2a-9d13-e2a9fca2f541 None None] Enqueued Resource ID: 59e4d693-d42b-419c-b40f-79e49d0d3391 with Priority: HIGHEST for action port [ 686.914098] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e4d693-d42b-419c-b40f-79e49d0d3391 with Priority: HIGHEST for action port [ 686.914098] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-59e4d693-d42b-419c-b40f-79e49d0d3391 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.914098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59e4d693-d42b-419c-b40f-79e49d0d3391" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.914420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59e4d693-d42b-419c-b40f-79e49d0d3391" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.914777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59e4d693-d42b-419c-b40f-79e49d0d3391" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.915057] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59e4d693-d42b-419c-b40f-79e49d0d3391',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.202023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.202023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.202023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.202023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.202023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.202023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.202023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.202023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.202023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.202023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.202023] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb is going to be updated. [ 687.202931] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.203348] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.203702] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.204288] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.204637] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.204897] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port a76837b3-8de3-4fe2-809d-081fe43ac642 not found, creating... [ 687.205634] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.206364] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.206670] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.207292] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.207602] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.207994] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.208384] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.211388] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.211388] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.211388] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.211388] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: a76837b3-8de3-4fe2-809d-081fe43ac642 is going to be created. [ 687.229693] env[69656]: INFO networking_nsxv3.common.synchronization [req-4fd510d4-8487-4394-951a-70e69c0256dd req-38630a3c-30f8-4953-a190-55db54831722 service nova] Enqueued Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_rules [ 687.229693] env[69656]: INFO networking_nsxv3.common.synchronization [req-4fd510d4-8487-4394-951a-70e69c0256dd req-38630a3c-30f8-4953-a190-55db54831722 service nova] Enqueued Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_members [ 687.229693] env[69656]: INFO networking_nsxv3.common.synchronization [req-4fd510d4-8487-4394-951a-70e69c0256dd req-38630a3c-30f8-4953-a190-55db54831722 service nova] Enqueued Resource ID: e8402221-e598-4782-bf0a-5b5f56558e7b with Priority: HIGHEST for action port [ 687.229693] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_rules [ 687.229693] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_members [ 687.229693] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8402221-e598-4782-bf0a-5b5f56558e7b with Priority: HIGHEST for action port [ 687.230937] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.231305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.231507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.232036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.232225] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.235335] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.235632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.235791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.236181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.236544] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.236781] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.236996] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.237495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.237709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.237997] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.239488] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8402221-e598-4782-bf0a-5b5f56558e7b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.239791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8402221-e598-4782-bf0a-5b5f56558e7b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.239961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8402221-e598-4782-bf0a-5b5f56558e7b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.240327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8402221-e598-4782-bf0a-5b5f56558e7b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.240531] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8402221-e598-4782-bf0a-5b5f56558e7b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.242678] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.243173] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.244082] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.244082] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.244308] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.244777] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-a76837b3-8de3-4fe2-809d-081fe43ac642" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.302785] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.302785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.302785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.303091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.303091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.315788] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: IN_PROGRESS for 2s [ 687.417969] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59e4d693-d42b-419c-b40f-79e49d0d3391 [ 687.419135] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.420604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.420604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.420604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.420604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.420604] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59e4d693-d42b-419c-b40f-79e49d0d3391 already deleted. [ 687.420604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59e4d693-d42b-419c-b40f-79e49d0d3391" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.740489] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.747596] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.747596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.747889] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8402221-e598-4782-bf0a-5b5f56558e7b with status ACTIVE [ 687.750198] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.750198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.750198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.750198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.750198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.750198] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.750198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.750198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.750198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.750198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.750198] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.750198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.750198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.752055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.752160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.752264] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8402221-e598-4782-bf0a-5b5f56558e7b is going to be updated. [ 687.778773] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.778773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.778773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.778773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.778956] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.778986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8402221-e598-4782-bf0a-5b5f56558e7b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.815997] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c36721c6-8615-4066-ad71-7555325052c1 in Status: SUCCESS [ 687.817917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.821017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.821017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.821017] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.821017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.821017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.821017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.821017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.821017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.821017] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c36721c6-8615-4066-ad71-7555325052c1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.243697] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.324113] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c36721c6-8615-4066-ad71-7555325052c1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.324113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.324113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.324273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.324780] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.324911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.324983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.325170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.325260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.325353] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.325508] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c36721c6-8615-4066-ad71-7555325052c1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.325647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.325754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.325865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.326018] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.326113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.326174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.326312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.326391] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.326473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.326628] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c36721c6-8615-4066-ad71-7555325052c1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.396416] env[69656]: INFO networking_nsxv3.common.synchronization [None req-1f852564-4881-45c8-a650-d5495f515440 None None] Enqueued Resource ID: 2ad01b1c-3677-4f2d-b099-c2bd9d271e57 with Priority: HIGHEST for action port [ 688.396416] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ad01b1c-3677-4f2d-b099-c2bd9d271e57 with Priority: HIGHEST for action port [ 688.396416] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ad01b1c-3677-4f2d-b099-c2bd9d271e57 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.396416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ad01b1c-3677-4f2d-b099-c2bd9d271e57" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.396416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ad01b1c-3677-4f2d-b099-c2bd9d271e57" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.396416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ad01b1c-3677-4f2d-b099-c2bd9d271e57" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.396416] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ad01b1c-3677-4f2d-b099-c2bd9d271e57',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.652937] env[69656]: INFO networking_nsxv3.common.synchronization [req-7485053b-e929-4fe8-bf92-eb01d597b2cc req-e48b7b7b-de15-45a2-bfcb-409bb5a0aa78 service nova] Enqueued Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_rules [ 688.653148] env[69656]: INFO networking_nsxv3.common.synchronization [req-7485053b-e929-4fe8-bf92-eb01d597b2cc req-e48b7b7b-de15-45a2-bfcb-409bb5a0aa78 service nova] Enqueued Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_members [ 688.653300] env[69656]: INFO networking_nsxv3.common.synchronization [req-7485053b-e929-4fe8-bf92-eb01d597b2cc req-e48b7b7b-de15-45a2-bfcb-409bb5a0aa78 service nova] Enqueued Resource ID: a76837b3-8de3-4fe2-809d-081fe43ac642 with Priority: HIGHEST for action port [ 688.653511] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_rules [ 688.653636] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_members [ 688.653728] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a76837b3-8de3-4fe2-809d-081fe43ac642 with Priority: HIGHEST for action port [ 688.657023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3521005-0bf3-4791-8930-fe6bb6c94423 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.657023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.657023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.657023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.657023] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.660267] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3521005-0bf3-4791-8930-fe6bb6c94423 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.660477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.660557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.660902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.661124] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.661195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.661280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.661469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.661574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.661708] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.662595] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-a76837b3-8de3-4fe2-809d-081fe43ac642 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.666036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a76837b3-8de3-4fe2-809d-081fe43ac642" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.666036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a76837b3-8de3-4fe2-809d-081fe43ac642" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.666036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a76837b3-8de3-4fe2-809d-081fe43ac642" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.666036] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a76837b3-8de3-4fe2-809d-081fe43ac642',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.747804] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.750857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.750857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.750857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.750857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.750857] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97579684-a77f-4bf3-9586-742120a2eca4 is going to be created. [ 688.776493] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.776853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.776853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.776967] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.777143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.788657] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: UNINITIALIZED for 2s [ 688.831892] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c36721c6-8615-4066-ad71-7555325052c1: rpc.has_security_group_logging(os_id): False [ 688.850116] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.850391] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.850511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.850960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.850960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.853161] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.853668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.854513] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.854513] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.854513] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.854513] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.854513] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.854819] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.855811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.855811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.855811] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.855811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.855811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.855811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.855811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.855811] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c36721c6-8615-4066-ad71-7555325052c1 is going to be created. [ 688.899670] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ad01b1c-3677-4f2d-b099-c2bd9d271e57 [ 688.902025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.902025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.902025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.902025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.902025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.902025] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ad01b1c-3677-4f2d-b099-c2bd9d271e57 already deleted. [ 688.902025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ad01b1c-3677-4f2d-b099-c2bd9d271e57" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.919372] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.919518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.919623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.919793] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.920827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.935121] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c36721c6-8615-4066-ad71-7555325052c1 in Status: IN_PROGRESS for 2s [ 689.167330] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3521005-0bf3-4791-8930-fe6bb6c94423 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.167634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.168274] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.170807] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a76837b3-8de3-4fe2-809d-081fe43ac642 with status ACTIVE [ 689.170882] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.170964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.171056] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.171267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.171349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.171617] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.171716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.171776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.171936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.171998] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.172254] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.172345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.172345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.172493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.172571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.172654] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a76837b3-8de3-4fe2-809d-081fe43ac642 is going to be updated. [ 689.216722] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.217175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.217175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.217175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.217342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.217451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a76837b3-8de3-4fe2-809d-081fe43ac642" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.325777] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: SUCCESS [ 689.325949] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb deletion is rescheduled due to dependency. [ 689.326077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.679196] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.898759] env[69656]: INFO networking_nsxv3.common.synchronization [None req-03c44003-7c32-441c-93a3-e783c0ff7071 None None] Enqueued Resource ID: 3fd9e3dc-13d7-4014-bc11-23bfbb739b5a with Priority: HIGHEST for action port [ 689.898759] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd9e3dc-13d7-4014-bc11-23bfbb739b5a with Priority: HIGHEST for action port [ 689.899448] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fd9e3dc-13d7-4014-bc11-23bfbb739b5a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.899448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fd9e3dc-13d7-4014-bc11-23bfbb739b5a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.899448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fd9e3dc-13d7-4014-bc11-23bfbb739b5a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.899689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fd9e3dc-13d7-4014-bc11-23bfbb739b5a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.899773] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd9e3dc-13d7-4014-bc11-23bfbb739b5a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.184294] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.184981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.185222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.185815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.186054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.186180] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3521005-0bf3-4791-8930-fe6bb6c94423 is going to be created. [ 690.219399] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.219563] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.219563] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.219756] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.221024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.229775] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: UNINITIALIZED for 2s [ 690.405459] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fd9e3dc-13d7-4014-bc11-23bfbb739b5a [ 690.405459] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.405689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.405689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.406034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.406034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.406177] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fd9e3dc-13d7-4014-bc11-23bfbb739b5a already deleted. [ 690.406220] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fd9e3dc-13d7-4014-bc11-23bfbb739b5a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.800522] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: SUCCESS [ 690.800522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.800522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.800522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.800522] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.800522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.800522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.800522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.800522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.800522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.800522] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.949557] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c36721c6-8615-4066-ad71-7555325052c1 in Status: SUCCESS [ 690.949557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.175137] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d1fef721-333b-404d-b96c-1b902917ea23 None None] Enqueued Resource ID: 6aed99a1-cd96-4296-b877-14a07e4266ee with Priority: HIGHEST for action port [ 691.175808] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aed99a1-cd96-4296-b877-14a07e4266ee with Priority: HIGHEST for action port [ 691.175920] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-6aed99a1-cd96-4296-b877-14a07e4266ee taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.176097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6aed99a1-cd96-4296-b877-14a07e4266ee" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.176362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6aed99a1-cd96-4296-b877-14a07e4266ee" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.176550] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6aed99a1-cd96-4296-b877-14a07e4266ee" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.176672] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6aed99a1-cd96-4296-b877-14a07e4266ee',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.306108] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.306108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.306108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.306108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.306108] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.306108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.306108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.306108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.306108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.306108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.306108] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.306108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.306108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.306108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.306108] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.306108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.306893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.306893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.306893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.307395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.307395] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.679737] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6aed99a1-cd96-4296-b877-14a07e4266ee [ 691.681115] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.681115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.681115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.681115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.681115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.681115] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6aed99a1-cd96-4296-b877-14a07e4266ee already deleted. [ 691.681115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6aed99a1-cd96-4296-b877-14a07e4266ee" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.814100] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97579684-a77f-4bf3-9586-742120a2eca4: rpc.has_security_group_logging(os_id): False [ 691.834269] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.834393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.834393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.834666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.834799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.835074] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.835208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.835650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.835650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.835650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.835845] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.835954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.836315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.836431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.836563] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.836792] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.836922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.837032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.837373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.837431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.837515] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97579684-a77f-4bf3-9586-742120a2eca4 is going to be created. [ 691.929721] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.929953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.930153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.930414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.930739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.948330] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: IN_PROGRESS for 2s [ 692.072919] env[69656]: INFO networking_nsxv3.common.synchronization [req-0bb7e846-8c1c-4407-baad-eb6f12e7a11e req-a1d699d9-ff72-4506-be9e-9ee3bcd3cb77 tempest-ServersWithSpecificFlavorTestJSON-7449257 tempest-ServersWithSpecificFlavorTestJSON-7449257-project-member] Enqueued Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_members [ 692.073891] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_members [ 692.077717] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.077931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.078034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.078375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.078570] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.078703] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.078769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.078934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.079035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.079147] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.241801] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: SUCCESS [ 692.242218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.242509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.242832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.243212] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.244259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.244259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.244259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.244259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.244472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.244542] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.582388] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.582388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.582388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.582613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.582613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.582798] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.582891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.582950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.583112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.583182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.583306] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 already deleted. [ 692.583336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.751192] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.815190] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-103 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.815454] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-103" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.815630] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-103" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.816888] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-103" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.818746] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.822975] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.823857] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.824235] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.824396] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.824628] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.824747] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.824857] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.825446] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.825446] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.825446] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.825446] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.848234] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.848234] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 692.848455] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.848725] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-103" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.849223] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-51764492-2e0b-40bf-a64a-0e2941e48c22 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.849420] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-51764492-2e0b-40bf-a64a-0e2941e48c22" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.849493] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-51764492-2e0b-40bf-a64a-0e2941e48c22" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.849812] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-51764492-2e0b-40bf-a64a-0e2941e48c22" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.850051] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51764492-2e0b-40bf-a64a-0e2941e48c22',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.190974] env[69656]: INFO networking_nsxv3.common.synchronization [None req-584869c5-77fd-4da4-9f27-6d35cf5ef5b0 tempest-ServersTestJSON-1445967154 tempest-ServersTestJSON-1445967154-project-member] Enqueued Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGHEST for action security_group_rules [ 693.191624] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGHEST for action security_group_rules [ 693.192024] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.192197] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.192286] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.192614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.192695] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5c76201-04fa-4fa1-bd82-b1756116b4c4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.253866] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3521005-0bf3-4791-8930-fe6bb6c94423: rpc.has_security_group_logging(os_id): False [ 693.273873] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.273873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.273873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.274207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.274207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.274504] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.274637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.274637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.274828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.274914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.274978] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3521005-0bf3-4791-8930-fe6bb6c94423 is going to be created. [ 693.335028] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.335746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.335905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.336220] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.336499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.349458] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: IN_PROGRESS for 2s [ 693.351537] env[69656]: INFO networking_nsxv3.common.synchronization [None req-abe6e085-810b-4e82-b6b8-f37f0b20626d None None] Enqueued Resource ID: 090cca9b-b7fa-4a4d-8e49-dbe41f42d368 with Priority: HIGHEST for action port [ 693.352020] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.352262] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.352476] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.352735] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.352873] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.353205] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 51764492-2e0b-40bf-a64a-0e2941e48c22 not found, creating... [ 693.353504] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.353955] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.354123] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.354437] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.354624] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.355020] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.355196] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.355315] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.355549] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.355685] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.355907] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 51764492-2e0b-40bf-a64a-0e2941e48c22 is going to be created. [ 693.356926] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 090cca9b-b7fa-4a4d-8e49-dbe41f42d368 with Priority: HIGHEST for action port [ 693.357826] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-090cca9b-b7fa-4a4d-8e49-dbe41f42d368 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.357826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-090cca9b-b7fa-4a4d-8e49-dbe41f42d368" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.357919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-090cca9b-b7fa-4a4d-8e49-dbe41f42d368" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.358155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-090cca9b-b7fa-4a4d-8e49-dbe41f42d368" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.358251] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('090cca9b-b7fa-4a4d-8e49-dbe41f42d368',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.376380] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.376681] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.376776] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.377375] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.378066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.378228] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-51764492-2e0b-40bf-a64a-0e2941e48c22" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.429992] env[69656]: INFO networking_nsxv3.common.synchronization [None req-c30618db-84f9-47e3-8ba7-17e6465b7dd7 tempest-ServersTestJSON-1445967154 tempest-ServersTestJSON-1445967154-project-member] Enqueued Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGHEST for action security_group_rules [ 693.430851] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGHEST for action security_group_rules [ 693.433078] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.433234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.711662] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.715327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.715327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.715327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.715327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.715327] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 already deleted. [ 693.715327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.715327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.715327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.715327] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5c76201-04fa-4fa1-bd82-b1756116b4c4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.833963] env[69656]: INFO networking_nsxv3.common.synchronization [req-5db1984a-47ff-48fa-bbda-b041e37363d0 req-9a6acee7-01ee-4d82-80a3-f3ba7c997b7e tempest-ServersV294TestFqdnHostnames-1402798877 tempest-ServersV294TestFqdnHostnames-1402798877-project-member] Enqueued Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGHEST for action security_group_members [ 693.834756] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGHEST for action security_group_members [ 693.835533] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e79ef0da-74c8-48fe-99d7-25b720dd4847 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.835533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.835698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.836085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.836305] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.836524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.836524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.836901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.836901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.836901] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.860509] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 090cca9b-b7fa-4a4d-8e49-dbe41f42d368 [ 693.861261] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.861261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.861261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.861261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.861490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.861490] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:090cca9b-b7fa-4a4d-8e49-dbe41f42d368 already deleted. [ 693.861490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-090cca9b-b7fa-4a4d-8e49-dbe41f42d368" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.962292] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: SUCCESS [ 693.962440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.235270] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.235546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.235546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.236342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.236342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.236342] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 already deleted. [ 694.236342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.339816] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.342019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.342019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.342019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.342019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.342019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.342019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.342019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.342019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.342019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.342019] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 already deleted. [ 694.342019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.720033] env[69656]: INFO networking_nsxv3.common.synchronization [None req-fafbb46b-3d87-4650-9839-ee14c216f4ee None None] Enqueued Resource ID: f63cdb1d-6ae0-4c45-856c-56f3b290b19d with Priority: HIGHEST for action port [ 694.720033] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f63cdb1d-6ae0-4c45-856c-56f3b290b19d with Priority: HIGHEST for action port [ 694.720332] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-f63cdb1d-6ae0-4c45-856c-56f3b290b19d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.720332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f63cdb1d-6ae0-4c45-856c-56f3b290b19d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.720332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f63cdb1d-6ae0-4c45-856c-56f3b290b19d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.720630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f63cdb1d-6ae0-4c45-856c-56f3b290b19d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.720729] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f63cdb1d-6ae0-4c45-856c-56f3b290b19d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.795581] env[69656]: INFO networking_nsxv3.common.synchronization [req-0bb7e846-8c1c-4407-baad-eb6f12e7a11e req-fae35d51-e499-4937-86c4-79ab54f4445d service nova] Enqueued Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_rules [ 694.795747] env[69656]: INFO networking_nsxv3.common.synchronization [req-0bb7e846-8c1c-4407-baad-eb6f12e7a11e req-fae35d51-e499-4937-86c4-79ab54f4445d service nova] Enqueued Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_members [ 694.796351] env[69656]: INFO networking_nsxv3.common.synchronization [req-0bb7e846-8c1c-4407-baad-eb6f12e7a11e req-fae35d51-e499-4937-86c4-79ab54f4445d service nova] Enqueued Resource ID: 51764492-2e0b-40bf-a64a-0e2941e48c22 with Priority: HIGHEST for action port [ 694.796351] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_rules [ 694.796515] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_members [ 694.796515] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51764492-2e0b-40bf-a64a-0e2941e48c22 with Priority: HIGHEST for action port [ 694.799100] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.799874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.799874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.799874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.799874] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.800926] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.802322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.802322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.802677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.802783] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.802906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.802973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.803149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.803238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.803359] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.807141] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-51764492-2e0b-40bf-a64a-0e2941e48c22 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.807141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51764492-2e0b-40bf-a64a-0e2941e48c22" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.807141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51764492-2e0b-40bf-a64a-0e2941e48c22" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.807141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51764492-2e0b-40bf-a64a-0e2941e48c22" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.807141] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51764492-2e0b-40bf-a64a-0e2941e48c22',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.812664] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-534 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.813781] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.813781] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.814169] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.814969] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.815296] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.818019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.818019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.818019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.818019] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.818019] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.818019] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.818019] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.818019] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.818019] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.818019] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.837328] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.837435] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 694.837491] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.837682] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.838050] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-b3ea5c6f-9be3-41f7-afe4-d3043f280ae3 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.838231] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-b3ea5c6f-9be3-41f7-afe4-d3043f280ae3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.838349] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-b3ea5c6f-9be3-41f7-afe4-d3043f280ae3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.838707] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-b3ea5c6f-9be3-41f7-afe4-d3043f280ae3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.838857] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3ea5c6f-9be3-41f7-afe4-d3043f280ae3',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.231027] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f63cdb1d-6ae0-4c45-856c-56f3b290b19d [ 695.231027] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.231027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.231027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.231027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.231027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.231027] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f63cdb1d-6ae0-4c45-856c-56f3b290b19d already deleted. [ 695.231027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f63cdb1d-6ae0-4c45-856c-56f3b290b19d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.297137] env[69656]: INFO networking_nsxv3.common.synchronization [req-b84b4133-ac4b-4139-825d-2cad6b3c1574 req-d7bf3d16-5382-460e-aed8-5dcb3e7f289d tempest-InstanceActionsTestJSON-574695347 tempest-InstanceActionsTestJSON-574695347-project-member] Enqueued Resource ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 with Priority: HIGHEST for action security_group_members [ 695.298227] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 with Priority: HIGHEST for action security_group_members [ 695.302093] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c27843-e365-4bd4-9103-dc94b0c2a637 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.302276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.302401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.302692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.302921] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.303678] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.303837] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.304123] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.304671] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.304671] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7c27843-e365-4bd4-9103-dc94b0c2a637',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.309942] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.309942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.309942] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.310721] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51764492-2e0b-40bf-a64a-0e2941e48c22 with status ACTIVE [ 695.310721] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.310913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.310913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.311089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.311183] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.311366] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.311464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.311524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.311683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.311758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.311943] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.317027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.317027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.317027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.317027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.317027] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51764492-2e0b-40bf-a64a-0e2941e48c22 is going to be updated. [ 695.335338] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.335547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.335591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.336321] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.336321] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.336321] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51764492-2e0b-40bf-a64a-0e2941e48c22" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.341841] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.342628] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.342628] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.342757] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.343166] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.343166] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port b3ea5c6f-9be3-41f7-afe4-d3043f280ae3 not found, creating... [ 695.343319] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.343487] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.343607] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.343858] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.344015] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.344336] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.344506] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.344640] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.344855] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.344998] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.345264] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: b3ea5c6f-9be3-41f7-afe4-d3043f280ae3 is going to be created. [ 695.361715] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: SUCCESS [ 695.361882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.363081] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.363348] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.363501] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.363798] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.364054] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.364600] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-b3ea5c6f-9be3-41f7-afe4-d3043f280ae3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.810263] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.813496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.813496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.813496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.813496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.813496] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.813496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.813496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.813496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.813496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.813496] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 is going to be updated. [ 695.818208] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.842381] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.843901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.843901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.844044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.844203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.853203] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 in Status: IN_PROGRESS for 2s [ 696.292953] env[69656]: INFO networking_nsxv3.common.synchronization [req-c16c45b0-bded-43f8-8c0e-8d41cfe66c4b req-4af05c6a-e65d-40c9-8616-d79d0066a8e2 tempest-ListServersNegativeTestJSON-1654090398 tempest-ListServersNegativeTestJSON-1654090398-project-member] Enqueued Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 696.299561] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 696.299561] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.299561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.299561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.299561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.300193] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.300193] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.300193] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.301095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.301546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.301718] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.318968] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.319188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.319234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.319535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.319667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.319770] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 is going to be created. [ 696.343830] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.344106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.344175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.344354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.344654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.355993] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: UNINITIALIZED for 2s [ 696.759875] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-172 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.760000] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-172" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.760058] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-172" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.760372] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-172" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.760633] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.760847] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.760905] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.761155] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.761540] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.761540] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.761630] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.761727] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.761837] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.762101] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.762101] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.762206] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.786149] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.786149] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.786149] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.786952] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-172" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.787817] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-c6b5bf8f-eba0-4e54-96b2-9a4130570fc1 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.787817] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-c6b5bf8f-eba0-4e54-96b2-9a4130570fc1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.787817] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-c6b5bf8f-eba0-4e54-96b2-9a4130570fc1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.788076] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-c6b5bf8f-eba0-4e54-96b2-9a4130570fc1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.788680] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6b5bf8f-eba0-4e54-96b2-9a4130570fc1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.789974] env[69656]: INFO networking_nsxv3.common.synchronization [None req-76f82049-dc80-4b95-9561-09ace0390e53 None None] Enqueued Resource ID: 3c20aed7-ce1d-460c-95de-233cd56da88b with Priority: HIGHEST for action port [ 696.790812] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c20aed7-ce1d-460c-95de-233cd56da88b with Priority: HIGHEST for action port [ 696.791094] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c20aed7-ce1d-460c-95de-233cd56da88b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.791222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c20aed7-ce1d-460c-95de-233cd56da88b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.793126] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c20aed7-ce1d-460c-95de-233cd56da88b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.793410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c20aed7-ce1d-460c-95de-233cd56da88b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.793506] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c20aed7-ce1d-460c-95de-233cd56da88b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.804841] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.804841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.804841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.805772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.805772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.805772] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.805772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.805772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.805772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.805772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.805772] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f636061-691e-4a7a-a595-1723a2745695 already deleted. [ 696.805772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.875307] env[69656]: INFO networking_nsxv3.common.synchronization [req-5db1984a-47ff-48fa-bbda-b041e37363d0 req-cfb85195-cc0e-4067-9c60-3f7c0a10cf01 service nova] Enqueued Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGHEST for action security_group_rules [ 696.875482] env[69656]: INFO networking_nsxv3.common.synchronization [req-5db1984a-47ff-48fa-bbda-b041e37363d0 req-cfb85195-cc0e-4067-9c60-3f7c0a10cf01 service nova] Enqueued Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGHEST for action security_group_members [ 696.875597] env[69656]: INFO networking_nsxv3.common.synchronization [req-5db1984a-47ff-48fa-bbda-b041e37363d0 req-cfb85195-cc0e-4067-9c60-3f7c0a10cf01 service nova] Enqueued Resource ID: b3ea5c6f-9be3-41f7-afe4-d3043f280ae3 with Priority: HIGHEST for action port [ 696.876144] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGHEST for action security_group_rules [ 696.876279] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGHEST for action security_group_members [ 696.876377] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3ea5c6f-9be3-41f7-afe4-d3043f280ae3 with Priority: HIGHEST for action port [ 696.876654] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e79ef0da-74c8-48fe-99d7-25b720dd4847 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.876777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.876836] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.877340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.877516] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.878781] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e79ef0da-74c8-48fe-99d7-25b720dd4847 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.879082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.879082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.879201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.879282] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.879382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.879439] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.879592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.879676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.879775] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.882092] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3ea5c6f-9be3-41f7-afe4-d3043f280ae3 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.882252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3ea5c6f-9be3-41f7-afe4-d3043f280ae3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.882320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3ea5c6f-9be3-41f7-afe4-d3043f280ae3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.882641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3ea5c6f-9be3-41f7-afe4-d3043f280ae3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.882641] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3ea5c6f-9be3-41f7-afe4-d3043f280ae3',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.006817] env[69656]: INFO networking_nsxv3.common.synchronization [None req-908f3b2f-e568-495f-bac4-16eec631b470 None None] Enqueued Resource ID: fa5a707a-63cb-4066-acd1-6366a03589cf with Priority: HIGHEST for action port [ 697.006817] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa5a707a-63cb-4066-acd1-6366a03589cf with Priority: HIGHEST for action port [ 697.006817] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa5a707a-63cb-4066-acd1-6366a03589cf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.006817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa5a707a-63cb-4066-acd1-6366a03589cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.006817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa5a707a-63cb-4066-acd1-6366a03589cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.006817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa5a707a-63cb-4066-acd1-6366a03589cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.006817] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa5a707a-63cb-4066-acd1-6366a03589cf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.292251] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.292251] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.292724] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.294025] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.294025] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.294025] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port c6b5bf8f-eba0-4e54-96b2-9a4130570fc1 not found, creating... [ 697.294025] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.294240] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.294240] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.294408] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.294593] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.294888] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.295942] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.296277] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.296520] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.296662] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.296805] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: c6b5bf8f-eba0-4e54-96b2-9a4130570fc1 is going to be created. [ 697.302775] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c20aed7-ce1d-460c-95de-233cd56da88b [ 697.302775] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.302775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.302775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.302775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.302775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.302775] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c20aed7-ce1d-460c-95de-233cd56da88b already deleted. [ 697.302775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c20aed7-ce1d-460c-95de-233cd56da88b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.326415] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.329249] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.329249] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.329249] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.329249] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.329249] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-c6b5bf8f-eba0-4e54-96b2-9a4130570fc1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.385775] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e79ef0da-74c8-48fe-99d7-25b720dd4847 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.385775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.386036] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.386893] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3ea5c6f-9be3-41f7-afe4-d3043f280ae3 with status ACTIVE [ 697.387104] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.387269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.387323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.390494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.390617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.390803] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.390931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.390993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.392056] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.392158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.392422] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.392511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.392554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.392714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.392788] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.392872] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3ea5c6f-9be3-41f7-afe4-d3043f280ae3 is going to be updated. [ 697.420281] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.420493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.420575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.420825] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.420977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.421912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3ea5c6f-9be3-41f7-afe4-d3043f280ae3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.513454] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa5a707a-63cb-4066-acd1-6366a03589cf [ 697.513675] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.513908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.513908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.514106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.514209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.514333] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa5a707a-63cb-4066-acd1-6366a03589cf already deleted. [ 697.514511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa5a707a-63cb-4066-acd1-6366a03589cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.867125] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 in Status: SUCCESS [ 697.868110] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 deletion is rescheduled due to dependency. [ 697.868110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.895323] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.084411] env[69656]: INFO networking_nsxv3.common.synchronization [req-c16c45b0-bded-43f8-8c0e-8d41cfe66c4b req-3900d04d-fcf9-42e1-af51-08c910e15df6 service nova] Enqueued Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_rules [ 698.084411] env[69656]: INFO networking_nsxv3.common.synchronization [req-c16c45b0-bded-43f8-8c0e-8d41cfe66c4b req-3900d04d-fcf9-42e1-af51-08c910e15df6 service nova] Enqueued Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 698.084411] env[69656]: INFO networking_nsxv3.common.synchronization [req-c16c45b0-bded-43f8-8c0e-8d41cfe66c4b req-3900d04d-fcf9-42e1-af51-08c910e15df6 service nova] Enqueued Resource ID: c6b5bf8f-eba0-4e54-96b2-9a4130570fc1 with Priority: HIGHEST for action port [ 698.084918] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_rules [ 698.085420] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 698.085585] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6b5bf8f-eba0-4e54-96b2-9a4130570fc1 with Priority: HIGHEST for action port [ 698.085875] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.086010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.086260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.086586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.086678] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.087729] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.087874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.087874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.088122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.089040] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.089040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.089040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.089040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.089040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.089040] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.091415] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6b5bf8f-eba0-4e54-96b2-9a4130570fc1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.091544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6b5bf8f-eba0-4e54-96b2-9a4130570fc1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.091544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6b5bf8f-eba0-4e54-96b2-9a4130570fc1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.091810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6b5bf8f-eba0-4e54-96b2-9a4130570fc1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.091810] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6b5bf8f-eba0-4e54-96b2-9a4130570fc1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.366017] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: SUCCESS [ 698.367347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.367347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.367347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.367347] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.367347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.367572] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.367607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.367684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.367787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.367865] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.400260] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.400260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.400260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.400260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.400260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.400260] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 is going to be created. [ 698.422837] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.422837] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.423084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.423137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.423270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.433646] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 in Status: UNINITIALIZED for 2s [ 698.593994] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.595070] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.598547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.598813] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6b5bf8f-eba0-4e54-96b2-9a4130570fc1 with status ACTIVE [ 698.599397] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.599397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.599397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.599637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.599637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.599715] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.599814] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.599868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.600975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.600975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.601166] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.601358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.601358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.601520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.601603] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.601693] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6b5bf8f-eba0-4e54-96b2-9a4130570fc1 is going to be updated. [ 698.623127] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.623240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.623321] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.623517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.623720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.623939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6b5bf8f-eba0-4e54-96b2-9a4130570fc1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.870714] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.959405] env[69656]: INFO networking_nsxv3.common.synchronization [req-c16c45b0-bded-43f8-8c0e-8d41cfe66c4b req-745ad2b2-03f7-4e4a-8018-0d9a1df9f6c2 tempest-ListServersNegativeTestJSON-1654090398 tempest-ListServersNegativeTestJSON-1654090398-project-member] Enqueued Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 698.960203] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 698.961277] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.961277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.104748] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.168225] env[69656]: INFO networking_nsxv3.common.synchronization [req-4904ea2b-dbbf-4285-931b-ed30dc789bb4 req-8036127e-94db-48b9-a53d-b60b6752cae3 tempest-ServerDiagnosticsTest-735963863 tempest-ServerDiagnosticsTest-735963863-project-member] Enqueued Resource ID: c36721c6-8615-4066-ad71-7555325052c1 with Priority: HIGHEST for action security_group_members [ 699.168775] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c36721c6-8615-4066-ad71-7555325052c1 with Priority: HIGHEST for action security_group_members [ 699.169176] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c36721c6-8615-4066-ad71-7555325052c1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.169320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.169320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.170369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.170369] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.170527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.170527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.170671] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.170763] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.170862] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c36721c6-8615-4066-ad71-7555325052c1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.374668] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b629ee2e-0b52-4f1a-9ab3-28190008dec5: rpc.has_security_group_logging(os_id): False [ 699.394814] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.394983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.395079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.395302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.395456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.395726] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.396122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.396297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.396500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.396583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.396722] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 is going to be created. [ 699.471665] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.471898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.471973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.472213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.472442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.486636] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: IN_PROGRESS for 2s [ 699.511268] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-172 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.511268] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-172" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.511268] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-172" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.511268] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-172" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.511268] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.511268] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.511268] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.511268] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.511704] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.511704] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.511765] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.511852] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.511939] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.512074] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.512178] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.512314] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.532107] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.532107] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 699.532320] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.535581] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-172" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.535581] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-240cce98-7174-4e3e-8547-6c681c63fc2c taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.535581] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-240cce98-7174-4e3e-8547-6c681c63fc2c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.535581] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-240cce98-7174-4e3e-8547-6c681c63fc2c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.535581] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-240cce98-7174-4e3e-8547-6c681c63fc2c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.535581] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('240cce98-7174-4e3e-8547-6c681c63fc2c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.608052] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.608052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.608052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.608052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.608052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.608052] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f636061-691e-4a7a-a595-1723a2745695 is going to be created. [ 699.612263] env[69656]: INFO networking_nsxv3.common.synchronization [None req-4c634ece-27b1-4e70-82d7-f382101d5785 None None] Enqueued Resource ID: 7279a190-37ac-48e9-b80d-75e6bd899a0c with Priority: HIGHEST for action port [ 699.612669] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7279a190-37ac-48e9-b80d-75e6bd899a0c with Priority: HIGHEST for action port [ 699.615459] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-7279a190-37ac-48e9-b80d-75e6bd899a0c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.615881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7279a190-37ac-48e9-b80d-75e6bd899a0c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.616970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7279a190-37ac-48e9-b80d-75e6bd899a0c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.616970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7279a190-37ac-48e9-b80d-75e6bd899a0c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.616970] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7279a190-37ac-48e9-b80d-75e6bd899a0c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.634630] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.634777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.634857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.635131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.635311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.646125] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: UNINITIALIZED for 2s [ 699.674338] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.674491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.674576] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.674816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.674909] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.675170] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.675271] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.675333] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.675493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.675568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.675668] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c36721c6-8615-4066-ad71-7555325052c1 is going to be updated. [ 699.710937] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.710937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.710937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.711290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.711290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.720079] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c36721c6-8615-4066-ad71-7555325052c1 in Status: IN_PROGRESS for 2s [ 700.037885] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.039029] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.040105] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.040457] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.040705] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.040968] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 240cce98-7174-4e3e-8547-6c681c63fc2c not found, creating... [ 700.041372] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.041616] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.041750] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.042062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.042262] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.042959] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.042959] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.043242] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.043535] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.043824] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.043899] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 240cce98-7174-4e3e-8547-6c681c63fc2c is going to be created. [ 700.063236] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.063236] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.063389] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.063602] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.063893] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.064279] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-240cce98-7174-4e3e-8547-6c681c63fc2c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.123023] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7279a190-37ac-48e9-b80d-75e6bd899a0c [ 700.123023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.123023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.123023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.123023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.123023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.123023] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7279a190-37ac-48e9-b80d-75e6bd899a0c already deleted. [ 700.123023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7279a190-37ac-48e9-b80d-75e6bd899a0c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.447078] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 in Status: SUCCESS [ 700.447078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.447078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.447078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.447078] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.447078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.447078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.447078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.447078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.447078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.447078] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.619855] env[69656]: INFO networking_nsxv3.common.synchronization [None req-8293af65-4ffb-4b3f-bf01-dec0f2f47ca6 None None] Enqueued Resource ID: a4dd067d-bdd2-43fe-b32a-bbdf3b7b741a with Priority: HIGHEST for action port [ 700.619855] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4dd067d-bdd2-43fe-b32a-bbdf3b7b741a with Priority: HIGHEST for action port [ 700.619855] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4dd067d-bdd2-43fe-b32a-bbdf3b7b741a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.619855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4dd067d-bdd2-43fe-b32a-bbdf3b7b741a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.619855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4dd067d-bdd2-43fe-b32a-bbdf3b7b741a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.622398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4dd067d-bdd2-43fe-b32a-bbdf3b7b741a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.622633] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4dd067d-bdd2-43fe-b32a-bbdf3b7b741a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.953018] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.108504] env[69656]: INFO networking_nsxv3.common.synchronization [req-c16c45b0-bded-43f8-8c0e-8d41cfe66c4b req-16fba97b-4fb7-4f2d-b94a-0c3030433c69 service nova] Enqueued Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_rules [ 701.108926] env[69656]: INFO networking_nsxv3.common.synchronization [req-c16c45b0-bded-43f8-8c0e-8d41cfe66c4b req-16fba97b-4fb7-4f2d-b94a-0c3030433c69 service nova] Enqueued Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 701.108926] env[69656]: INFO networking_nsxv3.common.synchronization [req-c16c45b0-bded-43f8-8c0e-8d41cfe66c4b req-16fba97b-4fb7-4f2d-b94a-0c3030433c69 service nova] Enqueued Resource ID: 240cce98-7174-4e3e-8547-6c681c63fc2c with Priority: HIGHEST for action port [ 701.109410] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_rules [ 701.109540] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 701.109633] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 240cce98-7174-4e3e-8547-6c681c63fc2c with Priority: HIGHEST for action port [ 701.110400] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.110400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.111500] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.112349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.112349] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-240cce98-7174-4e3e-8547-6c681c63fc2c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.112349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-240cce98-7174-4e3e-8547-6c681c63fc2c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.112349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-240cce98-7174-4e3e-8547-6c681c63fc2c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.112349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-240cce98-7174-4e3e-8547-6c681c63fc2c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.112349] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('240cce98-7174-4e3e-8547-6c681c63fc2c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.131400] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4dd067d-bdd2-43fe-b32a-bbdf3b7b741a [ 701.131400] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.131400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.131400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.131400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.131400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.132585] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4dd067d-bdd2-43fe-b32a-bbdf3b7b741a already deleted. [ 701.132585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4dd067d-bdd2-43fe-b32a-bbdf3b7b741a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.457511] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e79ef0da-74c8-48fe-99d7-25b720dd4847: rpc.has_security_group_logging(os_id): False [ 701.475271] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.475471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.475510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.475702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.475797] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.476073] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.476150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.476555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.476943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.477021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.477102] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 is going to be created. [ 701.501909] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: SUCCESS [ 701.502069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.546809] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.547050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.547050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.547261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.547456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.557136] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 in Status: IN_PROGRESS for 2s [ 701.614824] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 240cce98-7174-4e3e-8547-6c681c63fc2c with status ACTIVE [ 701.619149] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.619149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.619149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.619149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.619149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.619149] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.619149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.619149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.620898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.620898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.620898] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.620898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.620898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.620898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.620898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.620898] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 240cce98-7174-4e3e-8547-6c681c63fc2c is going to be updated. [ 701.652471] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.652610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.652647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.652913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.653523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.653738] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-240cce98-7174-4e3e-8547-6c681c63fc2c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.662832] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: SUCCESS [ 701.662832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.662832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.662832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.662832] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.662832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.662832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.662832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.662832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.662832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.662832] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.663637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.663855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.665288] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.665487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.665586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.665767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.665874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.665991] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.733022] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c36721c6-8615-4066-ad71-7555325052c1 in Status: SUCCESS [ 701.733022] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c36721c6-8615-4066-ad71-7555325052c1 deletion is rescheduled due to dependency. [ 701.733022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.970490] env[69656]: INFO networking_nsxv3.common.synchronization [None req-0346c6d3-9eff-4775-8e38-49dc644cb5f7 None None] Enqueued Resource ID: 2f88aeda-7d79-454e-8695-68a07f1fb65f with Priority: HIGHEST for action port [ 701.971115] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f88aeda-7d79-454e-8695-68a07f1fb65f with Priority: HIGHEST for action port [ 701.971435] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f88aeda-7d79-454e-8695-68a07f1fb65f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.971562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f88aeda-7d79-454e-8695-68a07f1fb65f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.971630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f88aeda-7d79-454e-8695-68a07f1fb65f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.971895] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f88aeda-7d79-454e-8695-68a07f1fb65f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.971980] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f88aeda-7d79-454e-8695-68a07f1fb65f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.028900] env[69656]: INFO networking_nsxv3.common.synchronization [req-c16c45b0-bded-43f8-8c0e-8d41cfe66c4b req-0a514fcb-d499-4150-93d4-82406972cbfe tempest-ListServersNegativeTestJSON-1654090398 tempest-ListServersNegativeTestJSON-1654090398-project-member] Enqueued Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 702.029913] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 702.031027] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.031139] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.168600] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.168600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.171274] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.476240] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f88aeda-7d79-454e-8695-68a07f1fb65f [ 702.476240] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.476240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.476240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.476627] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.476627] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.476627] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f88aeda-7d79-454e-8695-68a07f1fb65f already deleted. [ 702.476627] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f88aeda-7d79-454e-8695-68a07f1fb65f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.675467] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.813306] env[69656]: INFO networking_nsxv3.common.synchronization [None req-20c527f9-47c6-46ee-8be4-9a62482d90dd None None] Enqueued Resource ID: 4d87513d-5aef-4ddc-93ed-0bd3d3a01ac0 with Priority: HIGHEST for action port [ 702.814345] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d87513d-5aef-4ddc-93ed-0bd3d3a01ac0 with Priority: HIGHEST for action port [ 702.814575] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d87513d-5aef-4ddc-93ed-0bd3d3a01ac0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.814841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d87513d-5aef-4ddc-93ed-0bd3d3a01ac0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.814908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d87513d-5aef-4ddc-93ed-0bd3d3a01ac0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.815212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d87513d-5aef-4ddc-93ed-0bd3d3a01ac0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.815274] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d87513d-5aef-4ddc-93ed-0bd3d3a01ac0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.180572] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.180572] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.180572] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.180876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.181231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.181231] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f636061-691e-4a7a-a595-1723a2745695 is going to be updated. [ 703.211394] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.211596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.211596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.211747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.211888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.223060] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: IN_PROGRESS for 2s [ 703.318834] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d87513d-5aef-4ddc-93ed-0bd3d3a01ac0 [ 703.318931] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.319085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.319151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.319908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.321616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.321786] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d87513d-5aef-4ddc-93ed-0bd3d3a01ac0 already deleted. [ 703.323492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d87513d-5aef-4ddc-93ed-0bd3d3a01ac0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.569219] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 in Status: SUCCESS [ 703.569219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.782387] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-172 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.782623] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-172" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.782778] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-172" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.783073] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-172" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.783317] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.783477] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.783595] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.783811] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.783956] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.784817] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.785828] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.785828] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.785828] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.785828] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.785828] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.786645] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.804292] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.805240] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 703.805240] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.805240] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-172" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.806019] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-e8a8d837-e4ac-4906-9dbb-1d30c9f5367f taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.806019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-e8a8d837-e4ac-4906-9dbb-1d30c9f5367f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.806019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-e8a8d837-e4ac-4906-9dbb-1d30c9f5367f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.806807] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-e8a8d837-e4ac-4906-9dbb-1d30c9f5367f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.806959] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8a8d837-e4ac-4906-9dbb-1d30c9f5367f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.312866] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.312866] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.312866] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.312866] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.312866] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.312866] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port e8a8d837-e4ac-4906-9dbb-1d30c9f5367f not found, creating... [ 704.313137] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.313446] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.313536] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.313783] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.313923] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.314281] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.314451] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.314569] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.314792] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.314926] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.315668] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: e8a8d837-e4ac-4906-9dbb-1d30c9f5367f is going to be created. [ 704.334296] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.334296] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.334296] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.334867] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.334867] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.334967] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-e8a8d837-e4ac-4906-9dbb-1d30c9f5367f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.540922] env[69656]: INFO networking_nsxv3.common.synchronization [req-5fffbd50-f95a-40b6-a82c-1e929ee8ea17 req-b3c4c1c4-f829-4adf-a4cb-7e40022d1fde tempest-ImagesTestJSON-514277302 tempest-ImagesTestJSON-514277302-project-member] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 704.541323] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 704.541512] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.541700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.541784] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.544215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.544345] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.544459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.544527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.544715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.544821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.544919] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.050193] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.050193] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.050193] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.050617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.050617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.051060] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.051060] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.051240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.051466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.051616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.051743] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e already deleted. [ 705.051861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.234693] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: SUCCESS [ 705.236672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.236997] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.238297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.238641] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.239501] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.239501] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.242149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.242149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.242149] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.606251] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.607122] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.607588] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.607927] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.608751] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.609034] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.609184] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.609460] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.609645] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.609875] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.610010] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.610138] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.610269] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.610374] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.610556] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.610765] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.629237] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.632039] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 705.632039] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.632039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.632039] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-26766ff0-d56d-4cf5-a34b-c34bde438168 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.632039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-26766ff0-d56d-4cf5-a34b-c34bde438168" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.632039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-26766ff0-d56d-4cf5-a34b-c34bde438168" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.632039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-26766ff0-d56d-4cf5-a34b-c34bde438168" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.632039] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26766ff0-d56d-4cf5-a34b-c34bde438168',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.745490] env[69656]: INFO networking_nsxv3.common.synchronization [req-c16c45b0-bded-43f8-8c0e-8d41cfe66c4b req-ca76bf0f-8cd3-4df1-ab47-874f1fb2f89d service nova] Enqueued Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_rules [ 705.745490] env[69656]: INFO networking_nsxv3.common.synchronization [req-c16c45b0-bded-43f8-8c0e-8d41cfe66c4b req-ca76bf0f-8cd3-4df1-ab47-874f1fb2f89d service nova] Enqueued Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 705.745490] env[69656]: INFO networking_nsxv3.common.synchronization [req-c16c45b0-bded-43f8-8c0e-8d41cfe66c4b req-ca76bf0f-8cd3-4df1-ab47-874f1fb2f89d service nova] Enqueued Resource ID: e8a8d837-e4ac-4906-9dbb-1d30c9f5367f with Priority: HIGHEST for action port [ 705.745734] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.751023] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_rules [ 705.751023] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 705.751023] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8a8d837-e4ac-4906-9dbb-1d30c9f5367f with Priority: HIGHEST for action port [ 705.751023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.751023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.751023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.751023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.751023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8a8d837-e4ac-4906-9dbb-1d30c9f5367f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.751023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8a8d837-e4ac-4906-9dbb-1d30c9f5367f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.751023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8a8d837-e4ac-4906-9dbb-1d30c9f5367f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.751023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8a8d837-e4ac-4906-9dbb-1d30c9f5367f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.751023] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8a8d837-e4ac-4906-9dbb-1d30c9f5367f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.134470] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.134845] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.134845] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.135221] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.135396] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.135657] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 26766ff0-d56d-4cf5-a34b-c34bde438168 not found, creating... [ 706.135964] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.136187] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.136345] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.136663] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.136861] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.137679] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.137909] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.138049] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.138467] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.138467] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.138605] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 26766ff0-d56d-4cf5-a34b-c34bde438168 is going to be created. [ 706.145344] env[69656]: INFO networking_nsxv3.common.synchronization [None req-745882aa-25f5-4b54-92a8-a74fd55d7d50 None None] Enqueued Resource ID: 31d1c86d-83be-4b22-a2d1-8f692674a569 with Priority: HIGHEST for action port [ 706.145344] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d1c86d-83be-4b22-a2d1-8f692674a569 with Priority: HIGHEST for action port [ 706.145344] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-31d1c86d-83be-4b22-a2d1-8f692674a569 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.145344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31d1c86d-83be-4b22-a2d1-8f692674a569" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.145344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31d1c86d-83be-4b22-a2d1-8f692674a569" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.145344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31d1c86d-83be-4b22-a2d1-8f692674a569" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.145344] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31d1c86d-83be-4b22-a2d1-8f692674a569',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.159862] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.159862] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.159862] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.159862] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.159862] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.159862] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-26766ff0-d56d-4cf5-a34b-c34bde438168" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.249114] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.257027] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8a8d837-e4ac-4906-9dbb-1d30c9f5367f with status ACTIVE [ 706.257027] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.257027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.257027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.257027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.257027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.257027] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.257027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.257027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.257027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.257027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.257027] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.257027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.257027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.257027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.257027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.257027] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8a8d837-e4ac-4906-9dbb-1d30c9f5367f is going to be updated. [ 706.281108] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.281108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.281108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.281108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.281108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.281108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8a8d837-e4ac-4906-9dbb-1d30c9f5367f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.647920] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31d1c86d-83be-4b22-a2d1-8f692674a569 [ 706.648432] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.648512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.648576] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.648807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.648897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.648990] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31d1c86d-83be-4b22-a2d1-8f692674a569 already deleted. [ 706.649225] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31d1c86d-83be-4b22-a2d1-8f692674a569" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.751887] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.752589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.753867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.754255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.754422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.754660] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f636061-691e-4a7a-a595-1723a2745695 is going to be updated. [ 706.784676] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.784676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.784676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.784676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.784676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.794182] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: IN_PROGRESS for 2s [ 708.149568] env[69656]: INFO networking_nsxv3.common.synchronization [req-5fffbd50-f95a-40b6-a82c-1e929ee8ea17 req-b3c7112d-cae6-487a-9d6b-50addf74ae50 service nova] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_rules [ 708.149966] env[69656]: INFO networking_nsxv3.common.synchronization [req-5fffbd50-f95a-40b6-a82c-1e929ee8ea17 req-b3c7112d-cae6-487a-9d6b-50addf74ae50 service nova] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 708.149966] env[69656]: INFO networking_nsxv3.common.synchronization [req-5fffbd50-f95a-40b6-a82c-1e929ee8ea17 req-b3c7112d-cae6-487a-9d6b-50addf74ae50 service nova] Enqueued Resource ID: 26766ff0-d56d-4cf5-a34b-c34bde438168 with Priority: HIGHEST for action port [ 708.151504] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_rules [ 708.152312] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 708.152650] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26766ff0-d56d-4cf5-a34b-c34bde438168 with Priority: HIGHEST for action port [ 708.153857] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.153857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.153857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.155312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.156265] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.156626] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.157229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.157327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.157539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.157734] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.157841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.157903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.158059] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.158146] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.158236] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.159237] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-26766ff0-d56d-4cf5-a34b-c34bde438168 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.159510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26766ff0-d56d-4cf5-a34b-c34bde438168" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.159770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26766ff0-d56d-4cf5-a34b-c34bde438168" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.160492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26766ff0-d56d-4cf5-a34b-c34bde438168" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.160604] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26766ff0-d56d-4cf5-a34b-c34bde438168',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.662648] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.664025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.664184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.664514] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26766ff0-d56d-4cf5-a34b-c34bde438168 with status ACTIVE [ 708.664678] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.664781] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.664844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.665083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.665173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.665338] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.665430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.665490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.665642] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.665716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.665885] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.665972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.666432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.666611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.666691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.666776] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26766ff0-d56d-4cf5-a34b-c34bde438168 is going to be updated. [ 708.686213] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.687597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.687597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.687597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.687597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.687597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26766ff0-d56d-4cf5-a34b-c34bde438168" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.805364] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: SUCCESS [ 708.805364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.805364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.805364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.805364] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.805364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.805364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.805364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.805364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.805364] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.868213] env[69656]: INFO networking_nsxv3.common.synchronization [None req-236e7345-0f91-490f-b8d4-b59bd81da0c1 None None] Enqueued Resource ID: 023ff06f-3de3-4af6-b5ff-d9e16b766cbe with Priority: HIGHEST for action port [ 708.868213] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023ff06f-3de3-4af6-b5ff-d9e16b766cbe with Priority: HIGHEST for action port [ 708.868213] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-023ff06f-3de3-4af6-b5ff-d9e16b766cbe taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.868213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-023ff06f-3de3-4af6-b5ff-d9e16b766cbe" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.868213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-023ff06f-3de3-4af6-b5ff-d9e16b766cbe" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.870117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-023ff06f-3de3-4af6-b5ff-d9e16b766cbe" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.870117] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('023ff06f-3de3-4af6-b5ff-d9e16b766cbe',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.165866] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.307388] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.373520] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 023ff06f-3de3-4af6-b5ff-d9e16b766cbe [ 709.373753] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.373897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.373966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.374205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.374316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.374425] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:023ff06f-3de3-4af6-b5ff-d9e16b766cbe already deleted. [ 709.374514] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-023ff06f-3de3-4af6-b5ff-d9e16b766cbe" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.668477] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.668666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.668728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.668926] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.669050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.669239] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be created. [ 709.703062] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.703062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.703062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.703062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.703062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.713790] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: UNINITIALIZED for 2s [ 709.810134] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.312728] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.313087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.313087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.313168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.313395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.313498] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f636061-691e-4a7a-a595-1723a2745695 is going to be updated. [ 710.340483] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.341448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.341448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.341448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.341448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.352253] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: IN_PROGRESS for 2s [ 710.624353] env[69656]: INFO networking_nsxv3.common.synchronization [None req-9f2ada6d-d5d0-450d-bf97-9e242c6bc615 None None] Enqueued Resource ID: 0f1b8127-eb24-4808-95f1-18b4930b773b with Priority: HIGHEST for action port [ 710.626786] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f1b8127-eb24-4808-95f1-18b4930b773b with Priority: HIGHEST for action port [ 710.626786] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f1b8127-eb24-4808-95f1-18b4930b773b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.626786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f1b8127-eb24-4808-95f1-18b4930b773b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.626786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f1b8127-eb24-4808-95f1-18b4930b773b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.627030] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f1b8127-eb24-4808-95f1-18b4930b773b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.628430] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f1b8127-eb24-4808-95f1-18b4930b773b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.061887] env[69656]: INFO networking_nsxv3.common.synchronization [None req-8437eb50-bb19-4a84-a8bb-6f9a0aaa7619 None None] Enqueued Resource ID: fc4a16b5-b918-4637-85c3-e54840f86a65 with Priority: HIGHEST for action port [ 711.062204] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4a16b5-b918-4637-85c3-e54840f86a65 with Priority: HIGHEST for action port [ 711.063021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc4a16b5-b918-4637-85c3-e54840f86a65 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.063021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc4a16b5-b918-4637-85c3-e54840f86a65" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.063021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc4a16b5-b918-4637-85c3-e54840f86a65" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.064631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc4a16b5-b918-4637-85c3-e54840f86a65" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.064715] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc4a16b5-b918-4637-85c3-e54840f86a65',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.129277] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f1b8127-eb24-4808-95f1-18b4930b773b [ 711.129592] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.129765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.129852] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.130228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.130377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.131232] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f1b8127-eb24-4808-95f1-18b4930b773b already deleted. [ 711.131363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f1b8127-eb24-4808-95f1-18b4930b773b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.569081] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc4a16b5-b918-4637-85c3-e54840f86a65 [ 711.569393] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.569550] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.569616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.569826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.569911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.570011] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc4a16b5-b918-4637-85c3-e54840f86a65 already deleted. [ 711.570108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc4a16b5-b918-4637-85c3-e54840f86a65" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.721053] env[69656]: INFO networking_nsxv3.common.synchronization [None req-dbd93dee-2468-4e4f-9528-6bb202fdebd7 None None] Enqueued Resource ID: 03bfc02a-a5df-4e83-b4a5-261035668a6d with Priority: HIGHEST for action port [ 711.721053] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03bfc02a-a5df-4e83-b4a5-261035668a6d with Priority: HIGHEST for action port [ 711.721053] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-03bfc02a-a5df-4e83-b4a5-261035668a6d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.721053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03bfc02a-a5df-4e83-b4a5-261035668a6d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.721053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03bfc02a-a5df-4e83-b4a5-261035668a6d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.721053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03bfc02a-a5df-4e83-b4a5-261035668a6d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.721053] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03bfc02a-a5df-4e83-b4a5-261035668a6d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.730148] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 711.730148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.730148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.730148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.730148] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.730674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.731195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.731392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.731484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.731581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.731672] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.741513] env[69656]: INFO networking_nsxv3.common.synchronization [None req-3a29e146-d911-427f-b573-67e63f014adb None None] Enqueued Resource ID: da6edd77-49e1-437e-a673-089ec37907c3 with Priority: HIGHEST for action port [ 711.742661] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da6edd77-49e1-437e-a673-089ec37907c3 with Priority: HIGHEST for action port [ 711.742983] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-da6edd77-49e1-437e-a673-089ec37907c3 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.743834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da6edd77-49e1-437e-a673-089ec37907c3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.744318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da6edd77-49e1-437e-a673-089ec37907c3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.744318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da6edd77-49e1-437e-a673-089ec37907c3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.744431] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da6edd77-49e1-437e-a673-089ec37907c3',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.225914] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03bfc02a-a5df-4e83-b4a5-261035668a6d [ 712.226261] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.226421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.226504] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.227083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.227083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.227083] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03bfc02a-a5df-4e83-b4a5-261035668a6d already deleted. [ 712.227083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03bfc02a-a5df-4e83-b4a5-261035668a6d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.233797] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.233797] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.233797] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.234363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.234363] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.234363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.234516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.234679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.234679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.234866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.235075] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.235181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.235247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.235423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.235567] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.235688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.235739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.235852] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.235938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.236026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.236118] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.246907] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da6edd77-49e1-437e-a673-089ec37907c3 [ 712.247168] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.247347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.247436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.247702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.247846] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.247969] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da6edd77-49e1-437e-a673-089ec37907c3 already deleted. [ 712.248092] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da6edd77-49e1-437e-a673-089ec37907c3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.368274] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: SUCCESS [ 712.368560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.368786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.369082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.369335] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.369497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.369587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.369806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.369913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.372031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.372259] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.372573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.372573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.372762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.372884] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.373201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.373201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.373510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.373510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.373510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.373886] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.374901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.375069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.376202] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.376332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.376534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.376603] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.376650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.376773] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.737884] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a714e7c-1123-47f3-81e4-70f097603f3e: rpc.has_security_group_logging(os_id): False [ 712.754660] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.756511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.756615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.756862] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.756952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.757653] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.757653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.757928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.758129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.758129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.758447] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.759545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.759669] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.759859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.760106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.760379] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.760511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.760826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.760968] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.764023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.764023] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be created. [ 712.823376] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.823473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.824077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.824077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.824277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.836853] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 712.882025] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f636061-691e-4a7a-a595-1723a2745695: rpc.has_security_group_logging(os_id): False [ 712.882025] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.884293] env[69656]: INFO networking_nsxv3.common.synchronization [req-c5002fd8-8ddc-470b-a415-1d0586d29132 req-d8cfa775-2307-4b3a-9496-278a7b525e78 tempest-ListImageFiltersTestJSON-1291126279 tempest-ListImageFiltersTestJSON-1291126279-project-member] Enqueued Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_members [ 712.887610] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_members [ 712.887610] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.887610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.887610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.887610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.887610] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.887610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.887610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.887610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.887610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.887610] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.906322] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.909238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.909238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.909238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.909238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.909238] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.909238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.909238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.909637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.910032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.910299] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.910420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.910525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.910674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.910771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.911070] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.911150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.911150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.911342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.911376] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.911480] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f636061-691e-4a7a-a595-1723a2745695 is going to be created. [ 712.975684] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.975850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.976944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.976944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.976944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.989617] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: IN_PROGRESS for 2s [ 713.292966] env[69656]: INFO networking_nsxv3.common.synchronization [None req-18c4b737-1432-43d2-9f00-5c6954db63a0 None None] Enqueued Resource ID: 71812dfa-6e89-4234-a06a-5dff49f1ce19 with Priority: HIGHEST for action port [ 713.294361] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71812dfa-6e89-4234-a06a-5dff49f1ce19 with Priority: HIGHEST for action port [ 713.294514] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-71812dfa-6e89-4234-a06a-5dff49f1ce19 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.294928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71812dfa-6e89-4234-a06a-5dff49f1ce19" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.294994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71812dfa-6e89-4234-a06a-5dff49f1ce19" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.295812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71812dfa-6e89-4234-a06a-5dff49f1ce19" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.295812] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71812dfa-6e89-4234-a06a-5dff49f1ce19',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.384892] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.392471] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.392638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.392709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.393145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.393195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.393848] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.393848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.393848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.393848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.393848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.393848] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 already deleted. [ 713.394191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.801573] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71812dfa-6e89-4234-a06a-5dff49f1ce19 [ 713.801573] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.801573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.801573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.801573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.801573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.801573] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71812dfa-6e89-4234-a06a-5dff49f1ce19 already deleted. [ 713.801573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71812dfa-6e89-4234-a06a-5dff49f1ce19" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.887532] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.887532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.887532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.887746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.888624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.888624] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f636061-691e-4a7a-a595-1723a2745695 is going to be updated. [ 713.917815] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.918025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.918065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.918299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.918449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.931203] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: IN_PROGRESS for 2s [ 714.229310] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.230485] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.230485] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.230485] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.230485] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.234276] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.234509] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.234848] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.235038] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.235266] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.235394] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.237016] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.237016] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.237016] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.237016] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.237016] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.258513] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.258676] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 714.258815] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.258989] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.259319] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-637fdb3c-30b7-4b28-a053-87c9e20450b5 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.259504] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-637fdb3c-30b7-4b28-a053-87c9e20450b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.259623] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-637fdb3c-30b7-4b28-a053-87c9e20450b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.260000] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-637fdb3c-30b7-4b28-a053-87c9e20450b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.260246] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('637fdb3c-30b7-4b28-a053-87c9e20450b5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.764689] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.764879] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.765014] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.765317] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.766623] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.766852] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 637fdb3c-30b7-4b28-a053-87c9e20450b5 not found, creating... [ 714.767792] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.767792] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.767792] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.767792] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.767792] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.769087] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.770215] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.770352] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.770603] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.771281] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.771281] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 637fdb3c-30b7-4b28-a053-87c9e20450b5 is going to be created. [ 714.793762] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.794014] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.794160] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.794516] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.794689] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.794936] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-637fdb3c-30b7-4b28-a053-87c9e20450b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.854158] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 714.854707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.001642] env[69656]: INFO networking_nsxv3.common.synchronization [None req-a3cb3688-e4f0-4686-8986-45ec3a0a4867 None None] Enqueued Resource ID: 2d581856-e570-4bc5-8364-8a19a70256cf with Priority: HIGHEST for action port [ 715.001642] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d581856-e570-4bc5-8364-8a19a70256cf with Priority: HIGHEST for action port [ 715.002286] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d581856-e570-4bc5-8364-8a19a70256cf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.002444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d581856-e570-4bc5-8364-8a19a70256cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.002444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d581856-e570-4bc5-8364-8a19a70256cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.002707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d581856-e570-4bc5-8364-8a19a70256cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.002807] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d581856-e570-4bc5-8364-8a19a70256cf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.014779] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: SUCCESS [ 715.014779] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.014993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.015156] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.015244] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.505370] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d581856-e570-4bc5-8364-8a19a70256cf [ 715.506170] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.506637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.506988] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.508166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.508166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.508166] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d581856-e570-4bc5-8364-8a19a70256cf already deleted. [ 715.508166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d581856-e570-4bc5-8364-8a19a70256cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.521535] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.521535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.591899] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d4b7dad1-76cd-42bc-ab0b-866b855fdb45 None None] Enqueued Resource ID: 0b5e3728-ca06-4a06-ab84-3f2badcc3cf6 with Priority: HIGHEST for action port [ 715.593233] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b5e3728-ca06-4a06-ab84-3f2badcc3cf6 with Priority: HIGHEST for action port [ 715.597275] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b5e3728-ca06-4a06-ab84-3f2badcc3cf6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.597275] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b5e3728-ca06-4a06-ab84-3f2badcc3cf6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.597275] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b5e3728-ca06-4a06-ab84-3f2badcc3cf6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.597275] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b5e3728-ca06-4a06-ab84-3f2badcc3cf6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.597275] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b5e3728-ca06-4a06-ab84-3f2badcc3cf6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.942948] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: SUCCESS [ 715.943271] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.944152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.944231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.944436] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.944558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.944623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.944778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.944861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.944992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.945038] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.962967] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f2735e18-9f4c-42fa-a697-6ed2966e04c0 None None] Enqueued Resource ID: fb3ff75e-5665-4bb8-8022-305d18a59396 with Priority: HIGHEST for action port [ 715.963625] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3ff75e-5665-4bb8-8022-305d18a59396 with Priority: HIGHEST for action port [ 715.968023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb3ff75e-5665-4bb8-8022-305d18a59396 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.968023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb3ff75e-5665-4bb8-8022-305d18a59396" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.968023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb3ff75e-5665-4bb8-8022-305d18a59396" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.968023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb3ff75e-5665-4bb8-8022-305d18a59396" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.968023] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb3ff75e-5665-4bb8-8022-305d18a59396',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.975594] env[69656]: INFO networking_nsxv3.common.synchronization [req-c5002fd8-8ddc-470b-a415-1d0586d29132 req-6cf9bb76-77ac-4519-9904-94475af78987 service nova] Enqueued Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_rules [ 715.975849] env[69656]: INFO networking_nsxv3.common.synchronization [req-c5002fd8-8ddc-470b-a415-1d0586d29132 req-6cf9bb76-77ac-4519-9904-94475af78987 service nova] Enqueued Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_members [ 715.975993] env[69656]: INFO networking_nsxv3.common.synchronization [req-c5002fd8-8ddc-470b-a415-1d0586d29132 req-6cf9bb76-77ac-4519-9904-94475af78987 service nova] Enqueued Resource ID: 637fdb3c-30b7-4b28-a053-87c9e20450b5 with Priority: HIGHEST for action port [ 715.980024] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_rules [ 715.980024] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_members [ 715.980024] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 637fdb3c-30b7-4b28-a053-87c9e20450b5 with Priority: HIGHEST for action port [ 715.980024] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.980024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.980024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.980024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.980024] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.980024] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.980024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.980024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.980024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.980024] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.980024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.980024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.980024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.980024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.980024] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.981155] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-637fdb3c-30b7-4b28-a053-87c9e20450b5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.981155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-637fdb3c-30b7-4b28-a053-87c9e20450b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.981155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-637fdb3c-30b7-4b28-a053-87c9e20450b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.981155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-637fdb3c-30b7-4b28-a053-87c9e20450b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.981155] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('637fdb3c-30b7-4b28-a053-87c9e20450b5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.102731] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b5e3728-ca06-4a06-ab84-3f2badcc3cf6 [ 716.102999] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.103157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.103206] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.103471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.103600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.103719] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b5e3728-ca06-4a06-ab84-3f2badcc3cf6 already deleted. [ 716.103809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b5e3728-ca06-4a06-ab84-3f2badcc3cf6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.454737] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.454737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.454737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.454978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.455119] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.455230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.455310] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.455486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.455588] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.455686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.455845] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.456219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.456219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.456219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.456507] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.456507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.456507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.456665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.456751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.456836] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.457750] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.477919] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb3ff75e-5665-4bb8-8022-305d18a59396 [ 716.477919] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.477919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.477919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.481264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.481384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.481481] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb3ff75e-5665-4bb8-8022-305d18a59396 already deleted. [ 716.481564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb3ff75e-5665-4bb8-8022-305d18a59396" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.485031] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.485031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.485031] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.488614] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 637fdb3c-30b7-4b28-a053-87c9e20450b5 with status ACTIVE [ 716.490066] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.490244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.490403] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.490671] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.490822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.491053] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.493075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.493075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.493075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.493075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.493075] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.493075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.493356] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.494874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.497059] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.497059] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 637fdb3c-30b7-4b28-a053-87c9e20450b5 is going to be updated. [ 716.521143] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.521344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.521423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.521609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.521766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.521927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-637fdb3c-30b7-4b28-a053-87c9e20450b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.961424] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f636061-691e-4a7a-a595-1723a2745695: rpc.has_security_group_logging(os_id): False [ 716.982203] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.982367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.982434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.982891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.983137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.983850] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.983850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.983850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.984779] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.984779] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.987334] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.987455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.987532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.987792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.987852] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.988103] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.988223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.988282] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.988639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.988639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.988757] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f636061-691e-4a7a-a595-1723a2745695 is going to be updated. [ 716.989911] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.077257] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.077257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.077257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.077257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.077257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.092121] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: IN_PROGRESS for 2s [ 717.493821] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.495075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.495075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.495075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.495075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.495075] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 is going to be created. [ 717.518275] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.518445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.518526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.518740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.518918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.538282] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: UNINITIALIZED for 2s [ 718.972549] env[69656]: INFO networking_nsxv3.common.synchronization [None req-ce9af548-981a-4687-80dc-dede3a46b6cc None None] Enqueued Resource ID: aec8f522-d6da-48e7-9f91-8b12d1404d47 with Priority: HIGHEST for action port [ 718.972549] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec8f522-d6da-48e7-9f91-8b12d1404d47 with Priority: HIGHEST for action port [ 718.973655] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-aec8f522-d6da-48e7-9f91-8b12d1404d47 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.973655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aec8f522-d6da-48e7-9f91-8b12d1404d47" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.973655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aec8f522-d6da-48e7-9f91-8b12d1404d47" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.977026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aec8f522-d6da-48e7-9f91-8b12d1404d47" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.977026] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aec8f522-d6da-48e7-9f91-8b12d1404d47',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.106466] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: SUCCESS [ 719.106466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.106617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.106843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.106929] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.271104] env[69656]: INFO networking_nsxv3.common.synchronization [req-9f79bed4-1d7e-4fa8-9f96-af8c521c65f4 req-39e5a210-0f42-4348-a701-f03356e1fd7c tempest-ListServersNegativeTestJSON-1654090398 tempest-ListServersNegativeTestJSON-1654090398-project-member] Enqueued Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 719.271787] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 719.272887] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.275204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.275204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.275204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.275204] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.275204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.275484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.275974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.275974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.275974] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.478586] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aec8f522-d6da-48e7-9f91-8b12d1404d47 [ 719.479539] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.480493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.480939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.481634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.481817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.482011] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aec8f522-d6da-48e7-9f91-8b12d1404d47 already deleted. [ 719.482265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aec8f522-d6da-48e7-9f91-8b12d1404d47" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.550810] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: SUCCESS [ 719.550975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.551120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.551315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.551493] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.551620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.551687] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.551879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.551946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.551995] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.552092] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.611767] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.611924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.782123] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.056856] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.056856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.056856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.056856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.057651] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.057651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.058145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.058354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.058472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.058574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.058737] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.058834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.058897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.060093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.060300] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.060418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.060478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.060637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.060719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.061519] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.061631] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.199924] env[69656]: INFO networking_nsxv3.common.synchronization [req-e224371d-92ee-458e-838f-fe421f46189e req-a50b1bb5-f59d-454c-ab95-b0b88e075c02 tempest-ServersTestBootFromVolume-403368592 tempest-ServersTestBootFromVolume-403368592-project-member] Enqueued Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGHEST for action security_group_members [ 720.201426] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGHEST for action security_group_members [ 720.201426] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-53bb734e-5b1e-47d3-a1af-56162bde2894 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.201586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.201586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.202302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.202302] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.202302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.202302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.202625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.202625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.202625] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53bb734e-5b1e-47d3-a1af-56162bde2894',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.285230] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.566549] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6051e2d-23c6-4a8c-a86d-4ef24733ee00: rpc.has_security_group_logging(os_id): False [ 720.583309] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.583494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.583568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.583741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.583837] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.584037] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.584146] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.584208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.584376] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.584439] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.584629] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.584742] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.584796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.584920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.584992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.585382] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.585513] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.586662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.586785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.586872] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.586969] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 is going to be created. [ 720.642597] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.642735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.642811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.643033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.643723] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.653264] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: IN_PROGRESS for 2s [ 720.711694] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.711933] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.711933] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.712546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.712546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.712546] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.712780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.712780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.712940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.712981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.713114] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 already deleted. [ 720.713211] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.789017] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.789244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.789298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.789480] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.789570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.789669] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f636061-691e-4a7a-a595-1723a2745695 is going to be updated. [ 720.817074] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.817259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.817318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.817888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.817888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.828422] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: IN_PROGRESS for 2s [ 721.269636] env[69656]: INFO networking_nsxv3.common.synchronization [None req-e6d49a01-de1d-494b-b13f-0d7d9a3d537f None None] Enqueued Resource ID: 116957ec-902a-4acf-87cb-9b513e46e099 with Priority: HIGHEST for action port [ 721.269919] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 116957ec-902a-4acf-87cb-9b513e46e099 with Priority: HIGHEST for action port [ 721.270120] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-116957ec-902a-4acf-87cb-9b513e46e099 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.270561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-116957ec-902a-4acf-87cb-9b513e46e099" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.270561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-116957ec-902a-4acf-87cb-9b513e46e099" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.270561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-116957ec-902a-4acf-87cb-9b513e46e099" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.270960] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('116957ec-902a-4acf-87cb-9b513e46e099',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.682505] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-469 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.682707] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-469" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.682821] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-469" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.683203] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-469" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.683494] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.683606] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.683703] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.683920] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.687015] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.687310] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.687446] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.687566] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.687693] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.687819] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.687885] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.688032] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.706789] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.706979] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 721.706979] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.707164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-469" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.707475] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-a2676523-bf0b-41a4-87eb-b091c06787de taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.707651] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-a2676523-bf0b-41a4-87eb-b091c06787de" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.708450] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-a2676523-bf0b-41a4-87eb-b091c06787de" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.708450] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-a2676523-bf0b-41a4-87eb-b091c06787de" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.708450] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2676523-bf0b-41a4-87eb-b091c06787de',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.769078] env[69656]: INFO networking_nsxv3.common.synchronization [None req-9eb862bb-95dc-4c53-b38b-3fc4516b2c08 None None] Enqueued Resource ID: a83d6370-d44f-421e-b441-cb20a6b7ac43 with Priority: HIGHEST for action port [ 721.769892] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a83d6370-d44f-421e-b441-cb20a6b7ac43 with Priority: HIGHEST for action port [ 721.770332] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-a83d6370-d44f-421e-b441-cb20a6b7ac43 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.770499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a83d6370-d44f-421e-b441-cb20a6b7ac43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.770570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a83d6370-d44f-421e-b441-cb20a6b7ac43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.770907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a83d6370-d44f-421e-b441-cb20a6b7ac43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.771009] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a83d6370-d44f-421e-b441-cb20a6b7ac43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.776692] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 116957ec-902a-4acf-87cb-9b513e46e099 [ 721.776692] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.776692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.776692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.776692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.776692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.776692] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:116957ec-902a-4acf-87cb-9b513e46e099 already deleted. [ 721.776692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-116957ec-902a-4acf-87cb-9b513e46e099" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.128229] env[69656]: INFO networking_nsxv3.common.synchronization [None req-a1d2f187-a91d-4443-9860-0335acebd461 None None] Enqueued Resource ID: 16a2dfc5-c5ef-4cd5-99ee-deb91e64f78a with Priority: HIGHEST for action port [ 722.128801] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16a2dfc5-c5ef-4cd5-99ee-deb91e64f78a with Priority: HIGHEST for action port [ 722.129147] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-16a2dfc5-c5ef-4cd5-99ee-deb91e64f78a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.129271] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16a2dfc5-c5ef-4cd5-99ee-deb91e64f78a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.129335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16a2dfc5-c5ef-4cd5-99ee-deb91e64f78a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.129655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16a2dfc5-c5ef-4cd5-99ee-deb91e64f78a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.129756] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16a2dfc5-c5ef-4cd5-99ee-deb91e64f78a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.215619] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.215896] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.216063] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.216365] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.216542] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.216730] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port a2676523-bf0b-41a4-87eb-b091c06787de not found, creating... [ 722.217024] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.217203] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.217336] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.217567] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.217733] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.221378] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.221457] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.221573] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.221853] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.222009] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.222260] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: a2676523-bf0b-41a4-87eb-b091c06787de is going to be created. [ 722.243363] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.243596] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.244711] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.244711] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.244711] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.244711] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-a2676523-bf0b-41a4-87eb-b091c06787de" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.275195] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a83d6370-d44f-421e-b441-cb20a6b7ac43 [ 722.275602] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.275602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.275602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.275810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.275897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.275996] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a83d6370-d44f-421e-b441-cb20a6b7ac43 already deleted. [ 722.276127] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a83d6370-d44f-421e-b441-cb20a6b7ac43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.641374] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16a2dfc5-c5ef-4cd5-99ee-deb91e64f78a [ 722.641374] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.646172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.646172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.646172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.646172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.646172] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16a2dfc5-c5ef-4cd5-99ee-deb91e64f78a already deleted. [ 722.646172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16a2dfc5-c5ef-4cd5-99ee-deb91e64f78a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.667885] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: SUCCESS [ 722.668365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.842674] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: SUCCESS [ 722.842674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.842674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.842674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.842674] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.842674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.842674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.842674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.842674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.842674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.842674] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.098079] env[69656]: INFO networking_nsxv3.common.synchronization [req-dce597b6-b9fd-48ac-82ea-1204deef352a req-dde9b09f-5379-4a65-ade4-0bb46a6df3ab tempest-ListImageFiltersTestJSON-1291126279 tempest-ListImageFiltersTestJSON-1291126279-project-member] Enqueued Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_members [ 723.098653] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_members [ 723.098949] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.102031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.102105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.102792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.103501] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.104293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.104293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.104459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.104580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.104711] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.345798] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.345798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.345798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.345798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.345798] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.347066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.347066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.347066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.347066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.347066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.347066] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.347066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.347066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.347066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.347066] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.347066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.347066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.347066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.348070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.348070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.348070] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.605334] env[69656]: INFO networking_nsxv3.common.synchronization [req-e224371d-92ee-458e-838f-fe421f46189e req-289e5d9f-1bd1-40c5-9b33-e42e761d27d7 service nova] Enqueued Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGHEST for action security_group_rules [ 723.605497] env[69656]: INFO networking_nsxv3.common.synchronization [req-e224371d-92ee-458e-838f-fe421f46189e req-289e5d9f-1bd1-40c5-9b33-e42e761d27d7 service nova] Enqueued Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGHEST for action security_group_members [ 723.605629] env[69656]: INFO networking_nsxv3.common.synchronization [req-e224371d-92ee-458e-838f-fe421f46189e req-289e5d9f-1bd1-40c5-9b33-e42e761d27d7 service nova] Enqueued Resource ID: a2676523-bf0b-41a4-87eb-b091c06787de with Priority: HIGHEST for action port [ 723.605856] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGHEST for action security_group_rules [ 723.605980] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGHEST for action security_group_members [ 723.606278] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2676523-bf0b-41a4-87eb-b091c06787de with Priority: HIGHEST for action port [ 723.608595] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53bb734e-5b1e-47d3-a1af-56162bde2894 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.608595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.608595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.608920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.610023] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53bb734e-5b1e-47d3-a1af-56162bde2894',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.611135] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-53bb734e-5b1e-47d3-a1af-56162bde2894 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.611228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.611906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.612078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.612248] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.612347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.612408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.612563] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.612747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.612747] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53bb734e-5b1e-47d3-a1af-56162bde2894',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.613917] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2676523-bf0b-41a4-87eb-b091c06787de taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.613917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2676523-bf0b-41a4-87eb-b091c06787de" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.613917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2676523-bf0b-41a4-87eb-b091c06787de" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.613917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2676523-bf0b-41a4-87eb-b091c06787de" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.614211] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2676523-bf0b-41a4-87eb-b091c06787de',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.615055] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.669867] env[69656]: INFO networking_nsxv3.common.synchronization [None req-a1894bec-1963-4f0d-a824-00a0ebfa1a9c None None] Enqueued Resource ID: e1751bc3-326a-40f7-9c54-2cd09c3ab472 with Priority: HIGHEST for action port [ 723.669867] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1751bc3-326a-40f7-9c54-2cd09c3ab472 with Priority: HIGHEST for action port [ 723.671139] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1751bc3-326a-40f7-9c54-2cd09c3ab472 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.671481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1751bc3-326a-40f7-9c54-2cd09c3ab472" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.671658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1751bc3-326a-40f7-9c54-2cd09c3ab472" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.672197] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1751bc3-326a-40f7-9c54-2cd09c3ab472" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.673666] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1751bc3-326a-40f7-9c54-2cd09c3ab472',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.853138] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f636061-691e-4a7a-a595-1723a2745695: rpc.has_security_group_logging(os_id): False [ 723.874488] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.874673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.874673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.874934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.875050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.875269] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.875387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.875461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.875672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.875799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.876018] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.876094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.876168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.876311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.876391] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.878210] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.878384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.878485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.878667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.878763] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.878857] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f636061-691e-4a7a-a595-1723a2745695 is going to be updated. [ 723.935373] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.935587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.935664] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.935907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.936112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.953213] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: IN_PROGRESS for 2s [ 724.116620] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53bb734e-5b1e-47d3-a1af-56162bde2894',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.117128] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-53bb734e-5b1e-47d3-a1af-56162bde2894 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.117128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.122658] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.123596] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2676523-bf0b-41a4-87eb-b091c06787de with status ACTIVE [ 724.123736] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.123989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.123989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.124156] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.124260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.124430] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.124576] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.124624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.124751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.124861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.125025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.125552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.125552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.125552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.125552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.125552] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2676523-bf0b-41a4-87eb-b091c06787de is going to be updated. [ 724.152510] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.152668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.152741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.153721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.153721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.153721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2676523-bf0b-41a4-87eb-b091c06787de" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.176118] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1751bc3-326a-40f7-9c54-2cd09c3ab472 [ 724.176391] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.177083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.177083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.177083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.177083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.177083] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1751bc3-326a-40f7-9c54-2cd09c3ab472 already deleted. [ 724.177306] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1751bc3-326a-40f7-9c54-2cd09c3ab472" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.392101] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.394017] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.394017] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.394017] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.394017] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.394017] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.394017] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.394017] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.397765] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.397765] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.397765] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.397765] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.397765] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.397765] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.397765] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.397765] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.419474] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.419474] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 724.419474] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.419474] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.419474] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-77431853-06f4-4868-81a2-4b4e76cb5010 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.419474] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-77431853-06f4-4868-81a2-4b4e76cb5010" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.419474] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-77431853-06f4-4868-81a2-4b4e76cb5010" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.419917] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-77431853-06f4-4868-81a2-4b4e76cb5010" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.419917] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77431853-06f4-4868-81a2-4b4e76cb5010',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.516038] env[69656]: INFO networking_nsxv3.common.synchronization [None req-a5ea3a69-32f5-4a5e-814c-7a97640e5c56 None None] Enqueued Resource ID: 7727d144-8c2b-4335-b7a9-ba9728f2fa47 with Priority: HIGHEST for action port [ 724.516038] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7727d144-8c2b-4335-b7a9-ba9728f2fa47 with Priority: HIGHEST for action port [ 724.516038] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-7727d144-8c2b-4335-b7a9-ba9728f2fa47 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.516038] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7727d144-8c2b-4335-b7a9-ba9728f2fa47" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.516038] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7727d144-8c2b-4335-b7a9-ba9728f2fa47" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.516038] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7727d144-8c2b-4335-b7a9-ba9728f2fa47" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.516038] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7727d144-8c2b-4335-b7a9-ba9728f2fa47',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.619166] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53bb734e-5b1e-47d3-a1af-56162bde2894',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.630244] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.630396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.630487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.630695] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.630807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.630919] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 is going to be updated. [ 724.660318] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.660507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.660507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.660736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.660936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.669612] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: IN_PROGRESS for 2s [ 724.929065] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.929065] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.929065] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.929065] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.929065] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.929065] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 77431853-06f4-4868-81a2-4b4e76cb5010 not found, creating... [ 724.929065] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.929065] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.929065] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.930630] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.930794] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.931136] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.931303] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.931421] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.932742] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.932986] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.933128] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 77431853-06f4-4868-81a2-4b4e76cb5010 is going to be created. [ 724.954029] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.954029] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.954029] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.954029] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.954029] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.954370] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-77431853-06f4-4868-81a2-4b4e76cb5010" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.019277] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7727d144-8c2b-4335-b7a9-ba9728f2fa47 [ 725.019277] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.019277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.019277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.019277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.019277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.019277] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7727d144-8c2b-4335-b7a9-ba9728f2fa47 already deleted. [ 725.019277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7727d144-8c2b-4335-b7a9-ba9728f2fa47" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.122230] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.122230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.122230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.123680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.123680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.123680] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 is going to be created. [ 725.156122] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.156286] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.156357] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.156616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.157041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.166507] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 in Status: UNINITIALIZED for 2s [ 725.608766] env[69656]: INFO networking_nsxv3.common.synchronization [None req-4a2ff7e9-c3b7-4e75-b8f1-89e4e30ae29f None None] Enqueued Resource ID: a40e58dd-f11c-44c4-93e0-478c2eab8e08 with Priority: HIGHEST for action port [ 725.609163] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a40e58dd-f11c-44c4-93e0-478c2eab8e08 with Priority: HIGHEST for action port [ 725.613849] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-a40e58dd-f11c-44c4-93e0-478c2eab8e08 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.613849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a40e58dd-f11c-44c4-93e0-478c2eab8e08" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.613849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a40e58dd-f11c-44c4-93e0-478c2eab8e08" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.613849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a40e58dd-f11c-44c4-93e0-478c2eab8e08" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.613849] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a40e58dd-f11c-44c4-93e0-478c2eab8e08',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.968532] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: SUCCESS [ 725.968532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.005965] env[69656]: INFO networking_nsxv3.common.synchronization [req-ceb1a5c3-24e1-4ef8-8810-3529e6481d0f req-8c83b3e1-7fda-4107-9ff3-3c00f2a4379a tempest-ServerDiagnosticsNegativeTest-1010876267 tempest-ServerDiagnosticsNegativeTest-1010876267-project-member] Enqueued Resource ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 with Priority: HIGHEST for action security_group_members [ 726.005965] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 with Priority: HIGHEST for action security_group_members [ 726.005965] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-042dbbad-7370-4640-8e5b-325f400f2cd1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.005965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.005965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.005965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.006639] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.006894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.007079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.007416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.007627] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.008511] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('042dbbad-7370-4640-8e5b-325f400f2cd1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.069362] env[69656]: INFO networking_nsxv3.common.synchronization [None req-c2fde094-b675-42c8-9acb-de30d788dfb5 None None] Enqueued Resource ID: 2902595d-8a4a-48f7-9db6-386c8539301b with Priority: HIGHEST for action port [ 726.069953] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2902595d-8a4a-48f7-9db6-386c8539301b with Priority: HIGHEST for action port [ 726.071858] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-2902595d-8a4a-48f7-9db6-386c8539301b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.071858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2902595d-8a4a-48f7-9db6-386c8539301b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.071858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2902595d-8a4a-48f7-9db6-386c8539301b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.075528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2902595d-8a4a-48f7-9db6-386c8539301b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.075528] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2902595d-8a4a-48f7-9db6-386c8539301b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.121217] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a40e58dd-f11c-44c4-93e0-478c2eab8e08 [ 726.121217] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.121319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.121352] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.121578] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.121705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.121875] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a40e58dd-f11c-44c4-93e0-478c2eab8e08 already deleted. [ 726.121875] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a40e58dd-f11c-44c4-93e0-478c2eab8e08" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.170932] env[69656]: INFO networking_nsxv3.common.synchronization [req-dce597b6-b9fd-48ac-82ea-1204deef352a req-0fd58013-b329-4f13-aa6e-265ea282a333 service nova] Enqueued Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_rules [ 726.170932] env[69656]: INFO networking_nsxv3.common.synchronization [req-dce597b6-b9fd-48ac-82ea-1204deef352a req-0fd58013-b329-4f13-aa6e-265ea282a333 service nova] Enqueued Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_members [ 726.170932] env[69656]: INFO networking_nsxv3.common.synchronization [req-dce597b6-b9fd-48ac-82ea-1204deef352a req-0fd58013-b329-4f13-aa6e-265ea282a333 service nova] Enqueued Resource ID: 77431853-06f4-4868-81a2-4b4e76cb5010 with Priority: HIGHEST for action port [ 726.171217] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_rules [ 726.171762] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_members [ 726.171762] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77431853-06f4-4868-81a2-4b4e76cb5010 with Priority: HIGHEST for action port [ 726.171982] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.172124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.172184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.172473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.172473] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.173658] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.174865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.174865] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-77431853-06f4-4868-81a2-4b4e76cb5010 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.174865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77431853-06f4-4868-81a2-4b4e76cb5010" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.174865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77431853-06f4-4868-81a2-4b4e76cb5010" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.174865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77431853-06f4-4868-81a2-4b4e76cb5010" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.174865] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77431853-06f4-4868-81a2-4b4e76cb5010',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.511426] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.511636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.511636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.512355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.512355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.512355] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.512355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.512355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.512617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.512617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.512617] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 already deleted. [ 726.512707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.576350] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2902595d-8a4a-48f7-9db6-386c8539301b [ 726.576716] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.576886] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.576950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.577179] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.577555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.577555] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2902595d-8a4a-48f7-9db6-386c8539301b already deleted. [ 726.577555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2902595d-8a4a-48f7-9db6-386c8539301b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.679322] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.679322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.679322] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77431853-06f4-4868-81a2-4b4e76cb5010 with status ACTIVE [ 726.679984] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.679984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.679984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.679984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.680266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.680266] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.680402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.680489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.680855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.680855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.681138] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.681270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.681369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.684657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.684657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.684657] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77431853-06f4-4868-81a2-4b4e76cb5010 is going to be updated. [ 726.689035] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: SUCCESS [ 726.689035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.689035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.689035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.689035] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.691023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.691023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.691217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.692106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.692106] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.705843] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.705843] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.705843] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.705843] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.705843] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.705843] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.705843] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.705843] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.705843] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.706573] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.706573] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.706573] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.706573] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.706573] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.709320] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.709320] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.713990] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.713990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.713990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.713990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.713990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.713990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77431853-06f4-4868-81a2-4b4e76cb5010" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.731373] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.731677] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 726.731777] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.731987] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.732386] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-2b1d43c1-1710-44b8-be31-98ce4b48b326 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.732607] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-2b1d43c1-1710-44b8-be31-98ce4b48b326" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.732764] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-2b1d43c1-1710-44b8-be31-98ce4b48b326" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.733238] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-2b1d43c1-1710-44b8-be31-98ce4b48b326" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.733425] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b1d43c1-1710-44b8-be31-98ce4b48b326',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.811161] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f673fa17-9962-4e8e-9c34-ca4ecccb08ed tempest-ServerActionsTestOtherB-109014868 tempest-ServerActionsTestOtherB-109014868-project-member] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_rules [ 726.811723] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_rules [ 726.812774] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.813359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.813359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.813479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.813528] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.995314] env[69656]: INFO networking_nsxv3.common.synchronization [None req-07199c63-f1e1-488c-a482-8f96dab268c3 tempest-ServerActionsTestOtherB-109014868 tempest-ServerActionsTestOtherB-109014868-project-member] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_rules [ 726.995314] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_rules [ 726.995606] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.008085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.009995] env[69656]: INFO networking_nsxv3.common.synchronization [None req-4a943742-d1cd-42c6-8dd6-985f51384760 None None] Enqueued Resource ID: 63d80e5b-d0d6-443a-a7d6-470b4e5f00bf with Priority: HIGHEST for action port [ 727.010606] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63d80e5b-d0d6-443a-a7d6-470b4e5f00bf with Priority: HIGHEST for action port [ 727.011041] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-63d80e5b-d0d6-443a-a7d6-470b4e5f00bf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.011528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63d80e5b-d0d6-443a-a7d6-470b4e5f00bf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.011528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63d80e5b-d0d6-443a-a7d6-470b4e5f00bf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.012369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63d80e5b-d0d6-443a-a7d6-470b4e5f00bf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.012369] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63d80e5b-d0d6-443a-a7d6-470b4e5f00bf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.180011] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 in Status: SUCCESS [ 727.180011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.180011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.180011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.180011] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.180011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.180011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.180011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.180011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.180011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.180011] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53bb734e-5b1e-47d3-a1af-56162bde2894',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.197367] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.238908] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.239245] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.239669] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.239669] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.239890] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.239890] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 2b1d43c1-1710-44b8-be31-98ce4b48b326 not found, creating... [ 727.243217] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.243651] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.243651] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.243855] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.243933] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.244781] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.245058] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.245058] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.245432] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.245541] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.245618] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 2b1d43c1-1710-44b8-be31-98ce4b48b326 is going to be created. [ 727.264939] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.264939] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.264939] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.265202] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.265492] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.265565] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-2b1d43c1-1710-44b8-be31-98ce4b48b326" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.334772] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.335573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.335573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.335573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.342022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.342022] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 already deleted. [ 727.342022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.342022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.342022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.342022] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.516268] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63d80e5b-d0d6-443a-a7d6-470b4e5f00bf [ 727.517166] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.517315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.517387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.517599] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.517694] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.517786] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63d80e5b-d0d6-443a-a7d6-470b4e5f00bf already deleted. [ 727.517867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63d80e5b-d0d6-443a-a7d6-470b4e5f00bf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.681885] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53bb734e-5b1e-47d3-a1af-56162bde2894',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.702476] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.862899] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.863139] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.863139] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.863462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.863462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.863601] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 already deleted. [ 727.863638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.094278] env[69656]: INFO networking_nsxv3.common.synchronization [None req-ded65a62-5289-48fe-91f2-eaa20b65cc33 None None] Enqueued Resource ID: fed810d1-d372-45c3-bc31-f7f381a914dd with Priority: HIGHEST for action port [ 728.094278] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fed810d1-d372-45c3-bc31-f7f381a914dd with Priority: HIGHEST for action port [ 728.094278] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-fed810d1-d372-45c3-bc31-f7f381a914dd taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.094278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fed810d1-d372-45c3-bc31-f7f381a914dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.094278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fed810d1-d372-45c3-bc31-f7f381a914dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.094863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fed810d1-d372-45c3-bc31-f7f381a914dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.094991] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fed810d1-d372-45c3-bc31-f7f381a914dd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.187354] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53bb734e-5b1e-47d3-a1af-56162bde2894: rpc.has_security_group_logging(os_id): False [ 728.206565] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.207052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.207052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.207298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.207398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.207517] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 is going to be updated. [ 728.209652] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.210048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.210328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.210651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.210833] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.212418] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.212418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.212418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.212418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.212418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.212418] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 is going to be created. [ 728.249483] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.249772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.249892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.250172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.250363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.259483] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: IN_PROGRESS for 2s [ 728.307376] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.307626] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.307626] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.308628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.308628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.324039] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 in Status: IN_PROGRESS for 2s [ 728.603762] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fed810d1-d372-45c3-bc31-f7f381a914dd [ 728.604346] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.604346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.604346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.604346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.604629] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.604629] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fed810d1-d372-45c3-bc31-f7f381a914dd already deleted. [ 728.604629] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fed810d1-d372-45c3-bc31-f7f381a914dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.623497] env[69656]: INFO networking_nsxv3.common.synchronization [req-ceb1a5c3-24e1-4ef8-8810-3529e6481d0f req-00d3eebe-fc5d-46ee-a045-761f0e74a11c service nova] Enqueued Resource ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 with Priority: HIGHEST for action security_group_rules [ 728.623497] env[69656]: INFO networking_nsxv3.common.synchronization [req-ceb1a5c3-24e1-4ef8-8810-3529e6481d0f req-00d3eebe-fc5d-46ee-a045-761f0e74a11c service nova] Enqueued Resource ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 with Priority: HIGHEST for action security_group_members [ 728.624018] env[69656]: INFO networking_nsxv3.common.synchronization [req-ceb1a5c3-24e1-4ef8-8810-3529e6481d0f req-00d3eebe-fc5d-46ee-a045-761f0e74a11c service nova] Enqueued Resource ID: 2b1d43c1-1710-44b8-be31-98ce4b48b326 with Priority: HIGHEST for action port [ 728.624018] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 with Priority: HIGHEST for action security_group_rules [ 728.624110] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 with Priority: HIGHEST for action security_group_members [ 728.624149] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b1d43c1-1710-44b8-be31-98ce4b48b326 with Priority: HIGHEST for action port [ 728.626207] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-042dbbad-7370-4640-8e5b-325f400f2cd1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.627483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.627483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.627483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.627483] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('042dbbad-7370-4640-8e5b-325f400f2cd1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.628909] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-042dbbad-7370-4640-8e5b-325f400f2cd1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.629058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.629144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.631686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.631686] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.631686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.631686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.631686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.631686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.631686] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('042dbbad-7370-4640-8e5b-325f400f2cd1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.632878] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b1d43c1-1710-44b8-be31-98ce4b48b326 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.633027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b1d43c1-1710-44b8-be31-98ce4b48b326" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.633105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b1d43c1-1710-44b8-be31-98ce4b48b326" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.636122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b1d43c1-1710-44b8-be31-98ce4b48b326" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.636122] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b1d43c1-1710-44b8-be31-98ce4b48b326',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.135550] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-042dbbad-7370-4640-8e5b-325f400f2cd1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.135995] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.135995] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('042dbbad-7370-4640-8e5b-325f400f2cd1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.137430] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b1d43c1-1710-44b8-be31-98ce4b48b326 with status ACTIVE [ 729.138118] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.138327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.138454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.138797] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.139123] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.139495] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.139495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.139647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.139924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.140299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.140658] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.141359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.141359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.141359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.141359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.141359] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b1d43c1-1710-44b8-be31-98ce4b48b326 is going to be updated. [ 729.178525] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.178525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.178525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.178763] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.179590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.179590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b1d43c1-1710-44b8-be31-98ce4b48b326" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.643744] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('042dbbad-7370-4640-8e5b-325f400f2cd1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.772353] env[69656]: INFO networking_nsxv3.common.synchronization [None req-5ebf4ada-25c1-42b2-8eaf-f107434064ec None None] Enqueued Resource ID: bf9f8632-b2f4-4f89-997a-205b92bb8743 with Priority: HIGHEST for action port [ 729.772630] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9f8632-b2f4-4f89-997a-205b92bb8743 with Priority: HIGHEST for action port [ 729.773286] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf9f8632-b2f4-4f89-997a-205b92bb8743 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.773498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf9f8632-b2f4-4f89-997a-205b92bb8743" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.773498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf9f8632-b2f4-4f89-997a-205b92bb8743" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.773759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf9f8632-b2f4-4f89-997a-205b92bb8743" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.774149] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf9f8632-b2f4-4f89-997a-205b92bb8743',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.151303] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.151303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.151303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.151303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.151303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.151303] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 is going to be created. [ 730.179465] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.179699] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.179825] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.180496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.180711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.205074] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 in Status: UNINITIALIZED for 2s [ 730.272334] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: SUCCESS [ 730.272592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.272729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.272969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.274322] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.274322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.274322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.274322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.274322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.274322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.274322] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.279194] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf9f8632-b2f4-4f89-997a-205b92bb8743 [ 730.279194] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.279194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.279194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.279194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.279194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.279194] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf9f8632-b2f4-4f89-997a-205b92bb8743 already deleted. [ 730.279194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf9f8632-b2f4-4f89-997a-205b92bb8743" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.337628] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 in Status: SUCCESS [ 730.338596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.776683] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.776907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.776975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.777207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.777391] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.777496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.777562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.777716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.777805] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.778171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.778354] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.778459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.778539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.778875] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.778978] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.779067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.779135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.779293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.779453] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.779571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.779659] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.060601] env[69656]: INFO networking_nsxv3.common.synchronization [None req-e4c2a939-5c96-4cb2-9320-92ae01c1cf4a None None] Enqueued Resource ID: 6cfb1217-7b78-41b7-90d3-a4ccceed2277 with Priority: HIGHEST for action port [ 731.062576] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cfb1217-7b78-41b7-90d3-a4ccceed2277 with Priority: HIGHEST for action port [ 731.062576] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cfb1217-7b78-41b7-90d3-a4ccceed2277 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.062576] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cfb1217-7b78-41b7-90d3-a4ccceed2277" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.062576] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cfb1217-7b78-41b7-90d3-a4ccceed2277" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.062576] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cfb1217-7b78-41b7-90d3-a4ccceed2277" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.062576] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cfb1217-7b78-41b7-90d3-a4ccceed2277',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.282322] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6051e2d-23c6-4a8c-a86d-4ef24733ee00: rpc.has_security_group_logging(os_id): False [ 731.300675] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.300897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.300987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.301226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.301352] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.301583] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.301717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.301911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.302017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.302125] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.302332] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.302975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.302975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.302975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.302975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.302975] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.303330] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.303330] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.303330] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.303510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.303510] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 is going to be updated. [ 731.370587] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.370788] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.370862] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.371086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.373530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.388114] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: IN_PROGRESS for 2s [ 731.565853] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cfb1217-7b78-41b7-90d3-a4ccceed2277 [ 731.566160] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.566325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.566412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.567024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.568364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.568481] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cfb1217-7b78-41b7-90d3-a4ccceed2277 already deleted. [ 731.568612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cfb1217-7b78-41b7-90d3-a4ccceed2277" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.953895] env[69656]: INFO networking_nsxv3.common.synchronization [req-f820384e-d8cd-456a-af7c-e8e86e2ea45f req-0723e489-6e15-4a46-80fe-4cd2ce65ec69 tempest-ImagesOneServerTestJSON-1256148964 tempest-ImagesOneServerTestJSON-1256148964-project-member] Enqueued Resource ID: 4a133f47-cf05-42f1-8365-6a566b72e14d with Priority: HIGHEST for action security_group_members [ 731.954493] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a133f47-cf05-42f1-8365-6a566b72e14d with Priority: HIGHEST for action security_group_members [ 731.954961] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a133f47-cf05-42f1-8365-6a566b72e14d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.955240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.957569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.957569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.957569] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.957569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.957569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.957569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.957569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.957569] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a133f47-cf05-42f1-8365-6a566b72e14d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.044326] env[69656]: INFO networking_nsxv3.common.synchronization [None req-3b8cd8a3-b429-4d73-b7f8-814a97579ca5 None None] Enqueued Resource ID: 73539041-fb46-40f9-99ef-c03e684dfdf5 with Priority: HIGHEST for action port [ 732.044326] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73539041-fb46-40f9-99ef-c03e684dfdf5 with Priority: HIGHEST for action port [ 732.044326] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-73539041-fb46-40f9-99ef-c03e684dfdf5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.044326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73539041-fb46-40f9-99ef-c03e684dfdf5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.044326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73539041-fb46-40f9-99ef-c03e684dfdf5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.044326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73539041-fb46-40f9-99ef-c03e684dfdf5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.045539] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73539041-fb46-40f9-99ef-c03e684dfdf5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.217948] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 in Status: SUCCESS [ 732.217948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.217948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.217948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.217948] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.217948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.217948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.217948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.217948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.217948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.217948] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('042dbbad-7370-4640-8e5b-325f400f2cd1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.461580] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.461580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.461908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.461947] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.462176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.462548] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.462728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.462794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.463084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.463084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.463163] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a133f47-cf05-42f1-8365-6a566b72e14d is going to be updated. [ 732.511764] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.511764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.511764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.511764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.511764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.527421] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a133f47-cf05-42f1-8365-6a566b72e14d in Status: IN_PROGRESS for 2s [ 732.554288] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73539041-fb46-40f9-99ef-c03e684dfdf5 [ 732.554288] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.554288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.554288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.554288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.554288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.554288] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73539041-fb46-40f9-99ef-c03e684dfdf5 already deleted. [ 732.554288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73539041-fb46-40f9-99ef-c03e684dfdf5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.721265] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-042dbbad-7370-4640-8e5b-325f400f2cd1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.721437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.721437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.721639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.721809] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.722141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.722141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.722256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.722256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.722342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.722491] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-042dbbad-7370-4640-8e5b-325f400f2cd1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.722584] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.722649] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.722790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.722928] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.723036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.723097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.724775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.724775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.724775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.724775] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('042dbbad-7370-4640-8e5b-325f400f2cd1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.875683] env[69656]: INFO networking_nsxv3.common.synchronization [None req-a93d6d4d-73c9-4da6-b25f-0e01f946aa4e None None] Enqueued Resource ID: acf9698a-460c-4e49-ab48-edcd6b576f08 with Priority: HIGHEST for action port [ 732.875948] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acf9698a-460c-4e49-ab48-edcd6b576f08 with Priority: HIGHEST for action port [ 732.876558] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-acf9698a-460c-4e49-ab48-edcd6b576f08 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.876680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acf9698a-460c-4e49-ab48-edcd6b576f08" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.876746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acf9698a-460c-4e49-ab48-edcd6b576f08" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.877012] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acf9698a-460c-4e49-ab48-edcd6b576f08" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.879124] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acf9698a-460c-4e49-ab48-edcd6b576f08',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.175999] env[69656]: INFO networking_nsxv3.common.synchronization [req-3f56bd4b-8dbf-4aee-9547-04c8a844f138 req-78d57624-5f42-4616-a9fb-7ebf46cc4205 tempest-ServersTestJSON-1445967154 tempest-ServersTestJSON-1445967154-project-member] Enqueued Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGHEST for action security_group_members [ 733.176576] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGHEST for action security_group_members [ 733.177463] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5c76201-04fa-4fa1-bd82-b1756116b4c4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.177463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.177463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.177463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.177763] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.177763] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.177763] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.177946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.177946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.178030] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5c76201-04fa-4fa1-bd82-b1756116b4c4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.227857] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 042dbbad-7370-4640-8e5b-325f400f2cd1: rpc.has_security_group_logging(os_id): False [ 733.251203] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.252524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.252524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.252524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.252524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.252524] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.252777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.252777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.253093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.253607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.253842] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.253959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.254606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.254847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.254992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.255479] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.255479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.255761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.255761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.256887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.256887] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 is going to be created. [ 733.311851] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.312029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.312106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.312356] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.312544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.326213] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 in Status: IN_PROGRESS for 2s [ 733.382858] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port acf9698a-460c-4e49-ab48-edcd6b576f08 [ 733.383139] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.383317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.383396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.383691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.383691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.385196] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:acf9698a-460c-4e49-ab48-edcd6b576f08 already deleted. [ 733.385196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acf9698a-460c-4e49-ab48-edcd6b576f08" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.409115] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: SUCCESS [ 733.409115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.680949] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.681234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.681234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.681743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.681743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.681743] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.681978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.681978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.682094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.682182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.682507] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 already deleted. [ 733.682507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.840278] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-62 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.840278] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.840278] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.840523] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.841855] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.841855] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.841855] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.841855] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.841855] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.842189] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.842189] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.842266] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.848426] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.848426] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.848426] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.848426] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.869939] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.870284] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 733.870487] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.870833] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.871889] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-cb6158e0-9373-48e4-b9a9-7c312966a73a taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.874160] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-cb6158e0-9373-48e4-b9a9-7c312966a73a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.874160] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-cb6158e0-9373-48e4-b9a9-7c312966a73a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.874160] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-cb6158e0-9373-48e4-b9a9-7c312966a73a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.874160] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb6158e0-9373-48e4-b9a9-7c312966a73a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.376086] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.376255] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.376394] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.376655] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.376817] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.376986] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port cb6158e0-9373-48e4-b9a9-7c312966a73a not found, creating... [ 734.377272] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.377438] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.377558] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.377856] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.377954] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.378202] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.378358] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.378486] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.378728] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.378872] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.379042] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: cb6158e0-9373-48e4-b9a9-7c312966a73a is going to be created. [ 734.398391] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.398685] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.398767] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.399447] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.399447] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.399661] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-cb6158e0-9373-48e4-b9a9-7c312966a73a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.540436] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a133f47-cf05-42f1-8365-6a566b72e14d in Status: SUCCESS [ 734.541798] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a133f47-cf05-42f1-8365-6a566b72e14d deletion is rescheduled due to dependency. [ 734.543018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a133f47-cf05-42f1-8365-6a566b72e14d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.294664] env[69656]: INFO networking_nsxv3.common.synchronization [req-3f56bd4b-8dbf-4aee-9547-04c8a844f138 req-9339e562-3e6c-4a58-a8c3-e2586f677ea5 service nova] Enqueued Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGHEST for action security_group_rules [ 735.297886] env[69656]: INFO networking_nsxv3.common.synchronization [req-3f56bd4b-8dbf-4aee-9547-04c8a844f138 req-9339e562-3e6c-4a58-a8c3-e2586f677ea5 service nova] Enqueued Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGHEST for action security_group_members [ 735.297886] env[69656]: INFO networking_nsxv3.common.synchronization [req-3f56bd4b-8dbf-4aee-9547-04c8a844f138 req-9339e562-3e6c-4a58-a8c3-e2586f677ea5 service nova] Enqueued Resource ID: cb6158e0-9373-48e4-b9a9-7c312966a73a with Priority: HIGHEST for action port [ 735.297886] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGHEST for action security_group_rules [ 735.297886] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGHEST for action security_group_members [ 735.297886] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb6158e0-9373-48e4-b9a9-7c312966a73a with Priority: HIGHEST for action port [ 735.298921] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.299223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.301029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.301029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.301029] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5c76201-04fa-4fa1-bd82-b1756116b4c4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.301029] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5c76201-04fa-4fa1-bd82-b1756116b4c4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.301029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.301029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.301029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.301540] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.301760] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.301912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.302154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.302338] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.302524] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5c76201-04fa-4fa1-bd82-b1756116b4c4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.303968] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb6158e0-9373-48e4-b9a9-7c312966a73a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.304225] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb6158e0-9373-48e4-b9a9-7c312966a73a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.304605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb6158e0-9373-48e4-b9a9-7c312966a73a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.305021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb6158e0-9373-48e4-b9a9-7c312966a73a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.305021] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb6158e0-9373-48e4-b9a9-7c312966a73a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.338616] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 in Status: SUCCESS [ 735.339080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.392029] env[69656]: INFO networking_nsxv3.common.synchronization [None req-b0921359-b149-4944-9eb2-93a2b5131c5b None None] Enqueued Resource ID: 4ccc895d-81aa-43b4-b64d-7cc1cb0e33e1 with Priority: HIGHEST for action port [ 735.392029] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccc895d-81aa-43b4-b64d-7cc1cb0e33e1 with Priority: HIGHEST for action port [ 735.394074] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ccc895d-81aa-43b4-b64d-7cc1cb0e33e1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.394074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ccc895d-81aa-43b4-b64d-7cc1cb0e33e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.394074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ccc895d-81aa-43b4-b64d-7cc1cb0e33e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.394074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ccc895d-81aa-43b4-b64d-7cc1cb0e33e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.394074] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ccc895d-81aa-43b4-b64d-7cc1cb0e33e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.811079] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5c76201-04fa-4fa1-bd82-b1756116b4c4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.811079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.811079] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5c76201-04fa-4fa1-bd82-b1756116b4c4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.811079] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb6158e0-9373-48e4-b9a9-7c312966a73a with status ACTIVE [ 735.811079] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.811079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.811079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.811079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.811079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.811079] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.811079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.811079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.811079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.811079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.811813] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.811813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.811813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.811813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.811813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.811813] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb6158e0-9373-48e4-b9a9-7c312966a73a is going to be updated. [ 735.833138] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.833334] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.833374] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.833574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.833710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.833867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb6158e0-9373-48e4-b9a9-7c312966a73a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.842796] env[69656]: INFO networking_nsxv3.common.synchronization [None req-ad4cdd1c-0d01-4740-9c63-ba3da9c653dc tempest-VolumesAssistedSnapshotsTest-538466738 tempest-VolumesAssistedSnapshotsTest-538466738-project-member] Enqueued Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGHEST for action security_group_rules [ 735.843762] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGHEST for action security_group_rules [ 735.844231] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.844974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.845108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.847319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.847319] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.895985] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ccc895d-81aa-43b4-b64d-7cc1cb0e33e1 [ 735.896255] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.896403] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.896471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.896691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.896782] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.896874] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ccc895d-81aa-43b4-b64d-7cc1cb0e33e1 already deleted. [ 735.896953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ccc895d-81aa-43b4-b64d-7cc1cb0e33e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.978314] env[69656]: INFO networking_nsxv3.common.synchronization [None req-71a0bcf3-fa7b-4bd0-9921-214d117061b0 tempest-VolumesAssistedSnapshotsTest-538466738 tempest-VolumesAssistedSnapshotsTest-538466738-project-member] Enqueued Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGHEST for action security_group_rules [ 735.978919] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGHEST for action security_group_rules [ 735.979262] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.979372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.161718] env[69656]: INFO networking_nsxv3.common.synchronization [None req-b688c3f0-7c74-4507-a1ca-973c5a21711b None None] Enqueued Resource ID: c6304efa-13f4-4a46-91d4-d5b58b2c3fc5 with Priority: HIGHEST for action port [ 736.162475] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6304efa-13f4-4a46-91d4-d5b58b2c3fc5 with Priority: HIGHEST for action port [ 736.162628] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6304efa-13f4-4a46-91d4-d5b58b2c3fc5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.162752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6304efa-13f4-4a46-91d4-d5b58b2c3fc5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.162832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6304efa-13f4-4a46-91d4-d5b58b2c3fc5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.163108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6304efa-13f4-4a46-91d4-d5b58b2c3fc5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.163184] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6304efa-13f4-4a46-91d4-d5b58b2c3fc5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.314897] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5c76201-04fa-4fa1-bd82-b1756116b4c4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.373246] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.373430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.373499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.373688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.373781] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.373875] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f already deleted. [ 736.373959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.374143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.374308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.374423] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.387947] env[69656]: INFO networking_nsxv3.common.synchronization [req-362c2957-b954-4fef-8004-1fe93c3502ff req-9dc73e53-0284-4366-b5ee-b37ba86a7b65 tempest-ServersNegativeTestMultiTenantJSON-689681098 tempest-ServersNegativeTestMultiTenantJSON-689681098-project-member] Enqueued Resource ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b with Priority: HIGHEST for action security_group_members [ 736.391397] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b with Priority: HIGHEST for action security_group_members [ 736.392854] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-31cf519f-28de-486a-adaf-2d0102b1bc5b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.392854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.392854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.393630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.393630] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.393630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.393630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.393813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.393813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.393881] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31cf519f-28de-486a-adaf-2d0102b1bc5b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.665031] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6304efa-13f4-4a46-91d4-d5b58b2c3fc5 [ 736.665319] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.665512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.665574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.666777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.666777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.666777] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6304efa-13f4-4a46-91d4-d5b58b2c3fc5 already deleted. [ 736.666777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6304efa-13f4-4a46-91d4-d5b58b2c3fc5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.817972] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.818172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.818293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.818555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.819507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.819683] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 is going to be created. [ 736.842696] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.842884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.842973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.843230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.843421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.852593] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 in Status: UNINITIALIZED for 2s [ 736.901648] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.901948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.901948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.902084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.902172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.902266] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f already deleted. [ 736.902344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.902638] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.902745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.902792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.902944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.903026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.903186] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.903317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.903354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.903549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.907128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.907128] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b already deleted. [ 736.908823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.064739] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-550 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.064739] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-550" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.064739] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-550" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.064739] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-550" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.065925] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.065925] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.065925] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.065925] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.066763] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.066763] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.066763] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.066763] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.067324] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.067324] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.067324] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.067324] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.087427] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.087600] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 737.087735] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.087909] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-550" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.088244] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-93f95e95-1e52-4c7d-a7c3-a94bcb420427 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.088414] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-93f95e95-1e52-4c7d-a7c3-a94bcb420427" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.088531] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-93f95e95-1e52-4c7d-a7c3-a94bcb420427" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.088960] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-93f95e95-1e52-4c7d-a7c3-a94bcb420427" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.089138] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93f95e95-1e52-4c7d-a7c3-a94bcb420427',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.594304] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.594304] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.594304] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.594304] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.594304] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.594304] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 93f95e95-1e52-4c7d-a7c3-a94bcb420427 not found, creating... [ 737.594304] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.594304] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.594304] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.594304] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.594304] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.594952] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.594952] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.594952] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.594952] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.594952] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.595927] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 93f95e95-1e52-4c7d-a7c3-a94bcb420427 is going to be created. [ 737.616025] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.616025] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.616025] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.616428] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.616732] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.617039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-93f95e95-1e52-4c7d-a7c3-a94bcb420427" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.861960] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 in Status: SUCCESS [ 738.862263] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.862365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.862574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.862769] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.862898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.862948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.863124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.863208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.863317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.863409] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5c76201-04fa-4fa1-bd82-b1756116b4c4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.904298] env[69656]: INFO networking_nsxv3.common.synchronization [req-900dc856-6236-49f5-8166-2bfbcf918179 req-9987ce24-4b0e-48d2-84ac-c0786e10eef6 tempest-ImagesOneServerNegativeTestJSON-384940824 tempest-ImagesOneServerNegativeTestJSON-384940824-project-member] Enqueued Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 738.904781] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 738.905149] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.905276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.905345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.905598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.905752] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.905850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.905914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.907743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.907862] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.907968] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.927964] env[69656]: INFO networking_nsxv3.common.synchronization [req-362c2957-b954-4fef-8004-1fe93c3502ff req-49e6dd7d-c1b5-4d30-b894-b5e1aed6a6ed service nova] Enqueued Resource ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b with Priority: HIGHEST for action security_group_rules [ 738.928166] env[69656]: INFO networking_nsxv3.common.synchronization [req-362c2957-b954-4fef-8004-1fe93c3502ff req-49e6dd7d-c1b5-4d30-b894-b5e1aed6a6ed service nova] Enqueued Resource ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b with Priority: HIGHEST for action security_group_members [ 738.928304] env[69656]: INFO networking_nsxv3.common.synchronization [req-362c2957-b954-4fef-8004-1fe93c3502ff req-49e6dd7d-c1b5-4d30-b894-b5e1aed6a6ed service nova] Enqueued Resource ID: 93f95e95-1e52-4c7d-a7c3-a94bcb420427 with Priority: HIGHEST for action port [ 738.928976] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b with Priority: HIGHEST for action security_group_rules [ 738.930255] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b with Priority: HIGHEST for action security_group_members [ 738.930382] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f95e95-1e52-4c7d-a7c3-a94bcb420427 with Priority: HIGHEST for action port [ 738.930671] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31cf519f-28de-486a-adaf-2d0102b1bc5b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.930796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.930863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.931148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.931233] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31cf519f-28de-486a-adaf-2d0102b1bc5b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.932073] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-31cf519f-28de-486a-adaf-2d0102b1bc5b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.932195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.932312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.932434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.932581] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.932674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.932737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.932878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.932959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.933058] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31cf519f-28de-486a-adaf-2d0102b1bc5b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.934442] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-93f95e95-1e52-4c7d-a7c3-a94bcb420427 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.934584] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93f95e95-1e52-4c7d-a7c3-a94bcb420427" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.934656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93f95e95-1e52-4c7d-a7c3-a94bcb420427" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.935131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93f95e95-1e52-4c7d-a7c3-a94bcb420427" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.935233] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93f95e95-1e52-4c7d-a7c3-a94bcb420427',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.250969] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.251218] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.251311] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.251647] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.251927] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.252112] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.252227] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.252438] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.252575] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.254022] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 739.254022] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.254022] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.254022] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.254022] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 739.254022] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.254022] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.271482] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.271648] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 739.271788] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.271969] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.272281] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-9db2b039-5499-4d77-a679-b35689ae2b6c taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.272457] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-9db2b039-5499-4d77-a679-b35689ae2b6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.272576] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-9db2b039-5499-4d77-a679-b35689ae2b6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.273408] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-9db2b039-5499-4d77-a679-b35689ae2b6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.273408] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9db2b039-5499-4d77-a679-b35689ae2b6c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.369041] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5c76201-04fa-4fa1-bd82-b1756116b4c4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.411606] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.411761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.411831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.412061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.412158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.412347] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.412451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.412514] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.412667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.412746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.412832] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf already deleted. [ 739.412912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.436958] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93f95e95-1e52-4c7d-a7c3-a94bcb420427 with status ACTIVE [ 739.437240] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.437383] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.437453] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.437659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.437747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.437923] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.438034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.438096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.438253] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.438322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.438504] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.438654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.438765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.438874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.438950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.439053] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93f95e95-1e52-4c7d-a7c3-a94bcb420427 is going to be updated. [ 739.440268] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-31cf519f-28de-486a-adaf-2d0102b1bc5b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.440388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.440516] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31cf519f-28de-486a-adaf-2d0102b1bc5b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.462558] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.462702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.462768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.462983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.463140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.463301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93f95e95-1e52-4c7d-a7c3-a94bcb420427" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.775180] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.775427] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.775557] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.775852] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.776024] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.776194] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 9db2b039-5499-4d77-a679-b35689ae2b6c not found, creating... [ 739.776445] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.776983] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.776983] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.777109] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.777208] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.777493] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.777656] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.777775] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.777995] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.778504] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.782017] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 9db2b039-5499-4d77-a679-b35689ae2b6c is going to be created. [ 739.797774] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.797989] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.798132] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.798404] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.798805] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.799064] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-9db2b039-5499-4d77-a679-b35689ae2b6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.875183] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5c76201-04fa-4fa1-bd82-b1756116b4c4: rpc.has_security_group_logging(os_id): False [ 739.911026] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.911026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.911026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.911026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.911026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.911026] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.911026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.911026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.911026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.911508] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.911680] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 is going to be created. [ 739.943479] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31cf519f-28de-486a-adaf-2d0102b1bc5b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.975433] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.976706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.976706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.976706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.976706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.996478] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 in Status: IN_PROGRESS for 2s [ 740.428481] env[69656]: INFO networking_nsxv3.common.synchronization [req-7d935928-d287-4b71-a1c6-189aabe79f70 req-684905fc-92f1-4abc-a6a3-869b9927ae3f tempest-ServerDiagnosticsNegativeTest-1010876267 tempest-ServerDiagnosticsNegativeTest-1010876267-project-member] Enqueued Resource ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 with Priority: HIGHEST for action security_group_members [ 740.429127] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 with Priority: HIGHEST for action security_group_members [ 740.429427] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-042dbbad-7370-4640-8e5b-325f400f2cd1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.429548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.429636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.429807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.430023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.433058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.433152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.433355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.433446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.433548] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('042dbbad-7370-4640-8e5b-325f400f2cd1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.446789] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.446932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.447019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.447221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.447308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.447398] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b is going to be created. [ 740.470137] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.470137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.470137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.470290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.470411] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.479588] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b in Status: UNINITIALIZED for 2s [ 740.568760] env[69656]: INFO networking_nsxv3.common.synchronization [req-900dc856-6236-49f5-8166-2bfbcf918179 req-6fb75075-1e8e-4d89-bbe6-0d955fb1f0d7 service nova] Enqueued Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_rules [ 740.573092] env[69656]: INFO networking_nsxv3.common.synchronization [req-900dc856-6236-49f5-8166-2bfbcf918179 req-6fb75075-1e8e-4d89-bbe6-0d955fb1f0d7 service nova] Enqueued Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 740.573092] env[69656]: INFO networking_nsxv3.common.synchronization [req-900dc856-6236-49f5-8166-2bfbcf918179 req-6fb75075-1e8e-4d89-bbe6-0d955fb1f0d7 service nova] Enqueued Resource ID: 9db2b039-5499-4d77-a679-b35689ae2b6c with Priority: HIGHEST for action port [ 740.574876] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_rules [ 740.574876] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 740.574876] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9db2b039-5499-4d77-a679-b35689ae2b6c with Priority: HIGHEST for action port [ 740.574876] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.574876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.574876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.574876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.574876] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.579100] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.579100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.579100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.579100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.579100] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.579100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.579100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.579100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.579100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.580407] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.581696] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-9db2b039-5499-4d77-a679-b35689ae2b6c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.581945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9db2b039-5499-4d77-a679-b35689ae2b6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.582117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9db2b039-5499-4d77-a679-b35689ae2b6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.582355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9db2b039-5499-4d77-a679-b35689ae2b6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.582505] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9db2b039-5499-4d77-a679-b35689ae2b6c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.935352] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.935681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.935681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.936128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.936128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.936128] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.936384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.936384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.936429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.938843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.938843] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 is going to be updated. [ 740.982285] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.982553] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.982656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.983008] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.983261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.000530] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 in Status: IN_PROGRESS for 2s [ 741.085353] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.085353] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.085353] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.085501] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9db2b039-5499-4d77-a679-b35689ae2b6c with status ACTIVE [ 741.085642] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.085777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.088751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.088751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.088751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.088751] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.088751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.088751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.088751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.088751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.088751] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.088751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.088751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.088751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.088751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.088751] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9db2b039-5499-4d77-a679-b35689ae2b6c is going to be updated. [ 741.110768] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.110951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.111039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.111323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.111390] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.111541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9db2b039-5499-4d77-a679-b35689ae2b6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.589784] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.678109] env[69656]: INFO networking_nsxv3.common.synchronization [req-b5508c9c-7fb5-4787-b2ea-839fb1e7f640 req-5130e012-4a24-4df2-9b13-d9606453e4df tempest-ImagesTestJSON-514277302 tempest-ImagesTestJSON-514277302-project-member] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 741.678109] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 741.678109] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.678109] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.678109] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.678767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.679051] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.679262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.680493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.680772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.680944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.681125] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.015960] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 in Status: SUCCESS [ 742.017498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.092496] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.092861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.092935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.093204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.093292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.093387] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf is going to be created. [ 742.122230] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.122230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.122230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.122230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.122230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.130808] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: UNINITIALIZED for 2s [ 742.187365] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.187525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.187601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.187883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.187978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.188212] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.188307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.188436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.188529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.188609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.188717] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 742.214885] env[69656]: INFO networking_nsxv3.common.synchronization [req-a2ae92cb-41c7-486f-8acb-69b556e3ac5f req-d5bf2f18-c526-440a-bf7f-d385fffaf682 tempest-FloatingIPsAssociationTestJSON-1340927557 tempest-FloatingIPsAssociationTestJSON-1340927557-project-member] Enqueued Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_members [ 742.216382] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.216512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.216905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.216905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.216905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.218449] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_members [ 742.218525] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.218651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.218781] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.218959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.219127] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.219234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.219284] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.219425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.219570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.219619] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.231505] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 742.491645] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b in Status: SUCCESS [ 742.491929] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.492369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.492598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.492867] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.492956] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.492956] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.493125] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.493206] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.493293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.493415] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31cf519f-28de-486a-adaf-2d0102b1bc5b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.525275] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-524 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.525527] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-524" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.525752] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-524" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.526286] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-524" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.526644] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.526948] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.527090] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.527394] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.527571] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.527807] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.527956] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.528144] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.528289] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.528409] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.528517] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.528793] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.559420] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.559667] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 742.559863] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.560090] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-524" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.560439] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-e6d2995c-5894-49e0-bcc2-cd377ea768fa taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.560669] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-e6d2995c-5894-49e0-bcc2-cd377ea768fa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.561137] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-e6d2995c-5894-49e0-bcc2-cd377ea768fa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.561620] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-e6d2995c-5894-49e0-bcc2-cd377ea768fa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.561800] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6d2995c-5894-49e0-bcc2-cd377ea768fa',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.722642] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.998813] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-31cf519f-28de-486a-adaf-2d0102b1bc5b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.002174] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.002174] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-31cf519f-28de-486a-adaf-2d0102b1bc5b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.002174] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.002174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.002955] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.003178] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.003397] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31cf519f-28de-486a-adaf-2d0102b1bc5b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.017346] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 in Status: SUCCESS [ 743.017346] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 deletion is rescheduled due to dependency. [ 743.017346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.064462] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.064733] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.064839] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.065162] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.065314] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.065474] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port e6d2995c-5894-49e0-bcc2-cd377ea768fa not found, creating... [ 743.065788] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.065948] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.066132] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.066417] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.066499] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.066789] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.067036] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.067985] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.068276] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.068903] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.068903] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: e6d2995c-5894-49e0-bcc2-cd377ea768fa is going to be created. [ 743.089752] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.089752] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.089752] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.089752] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.089752] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.089752] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-e6d2995c-5894-49e0-bcc2-cd377ea768fa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.227243] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.509509] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31cf519f-28de-486a-adaf-2d0102b1bc5b: rpc.has_security_group_logging(os_id): False [ 743.526430] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.526760] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.526900] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.527169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.527270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.527478] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.527590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.527653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.527819] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.527897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.528098] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.528283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.528369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.528544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.528740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.529129] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.529491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.529491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.529587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.530276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.530512] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b is going to be created. [ 743.582588] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.582765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.582856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.583129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.583320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.598919] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b in Status: IN_PROGRESS for 2s [ 743.729570] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.729769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.729871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.730054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.730151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.730254] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97579684-a77f-4bf3-9586-742120a2eca4 is going to be updated. [ 743.763185] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.763361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.763448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.764191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.764354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.773925] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: IN_PROGRESS for 2s [ 743.813053] env[69656]: INFO networking_nsxv3.common.synchronization [req-a2ae92cb-41c7-486f-8acb-69b556e3ac5f req-f69316b8-2daf-4aff-9942-b3cf46715494 service nova] Enqueued Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_rules [ 743.813325] env[69656]: INFO networking_nsxv3.common.synchronization [req-a2ae92cb-41c7-486f-8acb-69b556e3ac5f req-f69316b8-2daf-4aff-9942-b3cf46715494 service nova] Enqueued Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_members [ 743.813469] env[69656]: INFO networking_nsxv3.common.synchronization [req-a2ae92cb-41c7-486f-8acb-69b556e3ac5f req-f69316b8-2daf-4aff-9942-b3cf46715494 service nova] Enqueued Resource ID: e6d2995c-5894-49e0-bcc2-cd377ea768fa with Priority: HIGHEST for action port [ 743.814042] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_rules [ 743.814195] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_members [ 743.814293] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d2995c-5894-49e0-bcc2-cd377ea768fa with Priority: HIGHEST for action port [ 743.814628] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.814717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.814769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.814953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.815049] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.815907] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.816013] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.817745] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6d2995c-5894-49e0-bcc2-cd377ea768fa taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.817745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6d2995c-5894-49e0-bcc2-cd377ea768fa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.817745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6d2995c-5894-49e0-bcc2-cd377ea768fa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.817745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6d2995c-5894-49e0-bcc2-cd377ea768fa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.817745] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6d2995c-5894-49e0-bcc2-cd377ea768fa',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.143056] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: UNINITIALIZED for 4s [ 744.240859] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 744.241095] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e deletion is rescheduled due to dependency. [ 744.241218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.319463] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.319463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.321868] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6d2995c-5894-49e0-bcc2-cd377ea768fa with status ACTIVE [ 744.323244] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.323438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.323511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.323733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.323827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.324049] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.324172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.325017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.325319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.325448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.325680] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.325847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.326277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.326459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.326583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.326698] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6d2995c-5894-49e0-bcc2-cd377ea768fa is going to be updated. [ 744.349177] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.349177] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.349177] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.349177] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.349177] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.349357] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6d2995c-5894-49e0-bcc2-cd377ea768fa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.142687] env[69656]: INFO networking_nsxv3.common.synchronization [req-111d021d-a7d2-43bd-886c-c8b0e4fd13c2 req-f0b14359-bccb-4f62-a6b8-cb79028e0f4d tempest-ImagesNegativeTestJSON-284269330 tempest-ImagesNegativeTestJSON-284269330-project-member] Enqueued Resource ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc with Priority: HIGHEST for action security_group_members [ 745.145394] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc with Priority: HIGHEST for action security_group_members [ 745.145394] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-45271c60-03cb-4886-a9a6-d3916a12e9bc taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.145394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.145394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.145394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.145394] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.145394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.145394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.145394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.145394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.145394] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45271c60-03cb-4886-a9a6-d3916a12e9bc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.619064] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b in Status: SUCCESS [ 745.619064] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.647464] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.647670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.647702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.647915] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.648011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.648215] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.648314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.648375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.648547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.648627] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.648730] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc already deleted. [ 745.648816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.764116] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-6 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.764334] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.764463] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.764817] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.765681] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.765681] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.765830] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.767039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.767039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.767039] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.767039] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.767039] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.767039] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.767039] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.767292] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.767292] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.785993] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: SUCCESS [ 745.785993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.785993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.785993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.785993] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.785993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.785993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.785993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.785993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.785993] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.792355] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.792355] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 745.792355] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.792355] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.792355] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.792355] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.792355] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.792355] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.792355] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.908026] env[69656]: INFO networking_nsxv3.common.synchronization [None req-9375ea43-3af0-4819-8b3a-fa25cf1c03a8 None None] Enqueued Resource ID: b09a2f9e-b7d7-4430-8260-537e36da7c33 with Priority: HIGHEST for action port [ 745.910620] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09a2f9e-b7d7-4430-8260-537e36da7c33 with Priority: HIGHEST for action port [ 745.910620] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-b09a2f9e-b7d7-4430-8260-537e36da7c33 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.910620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b09a2f9e-b7d7-4430-8260-537e36da7c33" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.910620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b09a2f9e-b7d7-4430-8260-537e36da7c33" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.910620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b09a2f9e-b7d7-4430-8260-537e36da7c33" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.910620] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09a2f9e-b7d7-4430-8260-537e36da7c33',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.152487] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: SUCCESS [ 746.155021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.155021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.155021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.155021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.155021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.155021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.155021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.155021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.155021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.155021] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.287542] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.299493] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.299493] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.299493] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.299493] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.299493] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.299493] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db not found, creating... [ 746.299493] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.299493] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.299493] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.299493] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.299493] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.300110] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.300110] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.300110] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.302844] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.303042] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.303228] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db is going to be created. [ 746.325466] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.325671] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.325794] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.326087] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.328017] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.328017] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.413747] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b09a2f9e-b7d7-4430-8260-537e36da7c33 [ 746.417032] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.417032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.417032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.417032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.417032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.417032] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b09a2f9e-b7d7-4430-8260-537e36da7c33 already deleted. [ 746.417032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b09a2f9e-b7d7-4430-8260-537e36da7c33" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.664030] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.664641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.664641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.667611] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.667611] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.667611] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.667611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.667611] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.791189] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.171449] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e938057-3189-4358-8ca5-5e18d05bbddf: rpc.has_security_group_logging(os_id): False [ 747.188348] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.188526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.188583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.189199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.189199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.189199] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.189510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.189510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.189510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.189636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.189707] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.189802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.189853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.190009] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.190100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.190300] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.190604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.190703] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.190858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.190950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.191093] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf is going to be created. [ 747.247653] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.247856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.251023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.251023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.251023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.261595] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: IN_PROGRESS for 2s [ 747.294548] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.294717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.294787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.295054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.295117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.295325] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97579684-a77f-4bf3-9586-742120a2eca4 is going to be updated. [ 747.345241] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.345241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.345241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.345241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.345241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.363479] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: IN_PROGRESS for 2s [ 747.517056] env[69656]: INFO networking_nsxv3.common.synchronization [req-111d021d-a7d2-43bd-886c-c8b0e4fd13c2 req-2c82d411-8c0e-49bc-9d92-985fa27c83ae service nova] Enqueued Resource ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc with Priority: HIGHEST for action security_group_rules [ 747.518025] env[69656]: INFO networking_nsxv3.common.synchronization [req-111d021d-a7d2-43bd-886c-c8b0e4fd13c2 req-2c82d411-8c0e-49bc-9d92-985fa27c83ae service nova] Enqueued Resource ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc with Priority: HIGHEST for action security_group_members [ 747.518025] env[69656]: INFO networking_nsxv3.common.synchronization [req-111d021d-a7d2-43bd-886c-c8b0e4fd13c2 req-2c82d411-8c0e-49bc-9d92-985fa27c83ae service nova] Enqueued Resource ID: 7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db with Priority: HIGHEST for action port [ 747.518025] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc with Priority: HIGHEST for action security_group_rules [ 747.518025] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc with Priority: HIGHEST for action security_group_members [ 747.518025] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db with Priority: HIGHEST for action port [ 747.518458] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45271c60-03cb-4886-a9a6-d3916a12e9bc taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.518597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.519164] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.519164] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.519164] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45271c60-03cb-4886-a9a6-d3916a12e9bc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.520520] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-45271c60-03cb-4886-a9a6-d3916a12e9bc taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.520691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.520691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.520892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.521062] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.521214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.521260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.521412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.521499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.521594] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45271c60-03cb-4886-a9a6-d3916a12e9bc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.526138] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.526138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.526138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.526138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.526138] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.021727] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-45271c60-03cb-4886-a9a6-d3916a12e9bc taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.021727] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.024182] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45271c60-03cb-4886-a9a6-d3916a12e9bc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.025298] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db with status ACTIVE [ 748.026444] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.026444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.026444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.026444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.026444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.026444] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.026774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.026774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.026774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.026902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.026996] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.027117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.027187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.027332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.027409] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.027492] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db is going to be updated. [ 748.068049] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.068266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.068266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.069051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.069150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.070134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bf2ceb3-bc0b-47f9-8a5b-2fdca49c96db" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.116941] env[69656]: INFO networking_nsxv3.common.synchronization [None req-3c85727e-d06c-4b69-8a5e-7cc683eaba15 None None] Enqueued Resource ID: 4fc5e7fa-8988-456d-a53d-ee7debabd65c with Priority: HIGHEST for action port [ 748.117229] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc5e7fa-8988-456d-a53d-ee7debabd65c with Priority: HIGHEST for action port [ 748.119028] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fc5e7fa-8988-456d-a53d-ee7debabd65c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.119028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fc5e7fa-8988-456d-a53d-ee7debabd65c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.119028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fc5e7fa-8988-456d-a53d-ee7debabd65c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.119718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fc5e7fa-8988-456d-a53d-ee7debabd65c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.119819] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fc5e7fa-8988-456d-a53d-ee7debabd65c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.126246] env[69656]: INFO networking_nsxv3.common.synchronization [req-21b9b9e5-be9d-4cae-82e9-db580cae6eb8 req-42b9b22d-8b25-443a-be8f-b69c4dc499bd tempest-ServersTestMultiNic-506331318 tempest-ServersTestMultiNic-506331318-project-member] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 748.127548] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 748.127951] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.128489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.128589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.128906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.129107] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.129198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.129262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.129434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.129523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.129613] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.531404] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45271c60-03cb-4886-a9a6-d3916a12e9bc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.622458] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4fc5e7fa-8988-456d-a53d-ee7debabd65c [ 748.622791] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.622987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.623103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.623394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.623523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.623658] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4fc5e7fa-8988-456d-a53d-ee7debabd65c already deleted. [ 748.626645] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fc5e7fa-8988-456d-a53d-ee7debabd65c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.636535] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.636741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.636843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.637165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.637289] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.637563] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.637790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.637790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.638010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.638144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.638263] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c already deleted. [ 748.638385] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.708379] env[69656]: INFO networking_nsxv3.common.synchronization [req-21b9b9e5-be9d-4cae-82e9-db580cae6eb8 req-32a758f4-f610-4ab6-ac0f-1ae5ec220e9d tempest-ServersTestMultiNic-506331318 tempest-ServersTestMultiNic-506331318-project-member] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 748.709093] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 748.709498] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.709665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.709765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.710321] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.710321] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.710450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.710480] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.710701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.710825] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.710957] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.034453] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.034663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.034707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.034905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.034999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.035125] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc is going to be created. [ 749.059813] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.060125] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.060251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.060575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.060774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.071071] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc in Status: UNINITIALIZED for 2s [ 749.213765] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.214048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.214167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.214402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.214497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.214698] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.214698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.214698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.214698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.214698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.214698] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c already deleted. [ 749.214698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.276715] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: SUCCESS [ 749.276972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.302035] env[69656]: INFO networking_nsxv3.common.synchronization [req-21b9b9e5-be9d-4cae-82e9-db580cae6eb8 req-1ecdad71-f651-47dd-b33a-f32e2681b284 tempest-ServersTestMultiNic-506331318 tempest-ServersTestMultiNic-506331318-project-member] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 749.302416] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 749.302739] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.302894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.303057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.303242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.303452] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.303560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.303560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.303771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.303771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.303845] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.372989] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: SUCCESS [ 749.373138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.373245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.373485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.373704] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.373905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.373905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.374082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.374168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.374260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.374362] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.806962] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.807235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.807270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.807488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.807581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.807823] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.809469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.809469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.809469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.809469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.809469] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c already deleted. [ 749.809469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.841490] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-315 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.841695] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.841821] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.842169] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.842430] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.842588] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.842704] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.842924] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.843087] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.843288] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.844102] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.844102] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.844102] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.844102] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.844102] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.844102] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.861323] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.861456] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 749.861663] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.861808] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.862148] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-8ebb6ad8-cab9-42d8-aaac-4119dd063789 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.862324] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-8ebb6ad8-cab9-42d8-aaac-4119dd063789" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.862442] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-8ebb6ad8-cab9-42d8-aaac-4119dd063789" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.862762] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-8ebb6ad8-cab9-42d8-aaac-4119dd063789" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.862902] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ebb6ad8-cab9-42d8-aaac-4119dd063789',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.876250] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.876436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.876508] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.876706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.876870] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.876986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.877069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.877235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.877311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.877397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.877544] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.877635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.877696] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.877833] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.877970] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.878069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.878120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.878257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.878328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.878408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.878493] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.366691] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.366932] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.367345] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.367444] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.367642] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.367888] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 8ebb6ad8-cab9-42d8-aaac-4119dd063789 not found, creating... [ 750.368251] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.368418] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.368554] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.368863] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.369015] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.369313] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.369469] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.369593] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.369819] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.369979] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.370151] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 8ebb6ad8-cab9-42d8-aaac-4119dd063789 is going to be created. [ 750.380204] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97579684-a77f-4bf3-9586-742120a2eca4: rpc.has_security_group_logging(os_id): False [ 750.394353] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.394646] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.394787] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.395082] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.395321] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.395560] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-8ebb6ad8-cab9-42d8-aaac-4119dd063789" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.402729] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.402948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.403079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.403355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.403494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.403759] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.403993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.404060] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.404283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.404429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.404702] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.404885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.404949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.405246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.405334] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.405593] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.405752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.405871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.406096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.406231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.406379] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97579684-a77f-4bf3-9586-742120a2eca4 is going to be updated. [ 750.481994] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.482153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.482226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.482444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.483717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.500688] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: IN_PROGRESS for 2s [ 751.080392] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc in Status: SUCCESS [ 751.081381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.081381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.081381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.081381] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.081381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.081381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.081646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.081646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.081754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.081858] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45271c60-03cb-4886-a9a6-d3916a12e9bc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.545672] env[69656]: INFO networking_nsxv3.common.synchronization [req-21b9b9e5-be9d-4cae-82e9-db580cae6eb8 req-9bfaf456-f3ed-4c3c-8cf1-140a93e2e3f4 service nova] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_rules [ 751.546339] env[69656]: INFO networking_nsxv3.common.synchronization [req-21b9b9e5-be9d-4cae-82e9-db580cae6eb8 req-9bfaf456-f3ed-4c3c-8cf1-140a93e2e3f4 service nova] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 751.546578] env[69656]: INFO networking_nsxv3.common.synchronization [req-21b9b9e5-be9d-4cae-82e9-db580cae6eb8 req-9bfaf456-f3ed-4c3c-8cf1-140a93e2e3f4 service nova] Enqueued Resource ID: 8ebb6ad8-cab9-42d8-aaac-4119dd063789 with Priority: HIGHEST for action port [ 751.547271] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_rules [ 751.547458] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 751.547703] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ebb6ad8-cab9-42d8-aaac-4119dd063789 with Priority: HIGHEST for action port [ 751.548042] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.548218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.548309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.548592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.548711] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.550574] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.551130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.551798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.552254] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.553110] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.553303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.553810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.554020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.554151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.555131] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.556050] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ebb6ad8-cab9-42d8-aaac-4119dd063789 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.556834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ebb6ad8-cab9-42d8-aaac-4119dd063789" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.557721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ebb6ad8-cab9-42d8-aaac-4119dd063789" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.557960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ebb6ad8-cab9-42d8-aaac-4119dd063789" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.558086] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ebb6ad8-cab9-42d8-aaac-4119dd063789',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.583785] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-45271c60-03cb-4886-a9a6-d3916a12e9bc taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.584162] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.584278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.584516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.584685] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.584812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.584885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.585093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.585223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.585322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.585481] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-45271c60-03cb-4886-a9a6-d3916a12e9bc taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.585580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.585641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.585785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.585922] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.586022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.586084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.586221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.586298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.586379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.586466] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45271c60-03cb-4886-a9a6-d3916a12e9bc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.065460] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.065541] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.065616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.065830] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ebb6ad8-cab9-42d8-aaac-4119dd063789 with status ACTIVE [ 752.066025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.066145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.066208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.066495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.066601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.066875] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.067617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.067724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.067953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.068077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.068282] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.068439] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.068439] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.068651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.068794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.068883] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ebb6ad8-cab9-42d8-aaac-4119dd063789 is going to be updated. [ 752.088856] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45271c60-03cb-4886-a9a6-d3916a12e9bc: rpc.has_security_group_logging(os_id): False [ 752.091628] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.092027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.092171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.092574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.092784] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.095020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ebb6ad8-cab9-42d8-aaac-4119dd063789" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.123710] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.123710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.123710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.123710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.123710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.123710] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.123710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.124138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.124138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.124138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.124266] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.124337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.124377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.124809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.124809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.124809] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.124971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.125539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.125715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.125823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.126028] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc is going to be created. [ 752.204443] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.204644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.204693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.204873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.205068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.229090] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc in Status: IN_PROGRESS for 2s [ 752.357177] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.357177] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-628" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.358127] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-628" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.358127] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-628" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.358127] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.358127] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.358127] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.358482] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.358547] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.358709] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.358852] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.360942] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.360942] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.360942] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.360942] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.360942] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.382978] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.382978] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 752.382978] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.382978] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-628" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.383357] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-45f26561-dae0-4056-93af-b30eb5c24932 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.383573] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-45f26561-dae0-4056-93af-b30eb5c24932" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.383656] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-45f26561-dae0-4056-93af-b30eb5c24932" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.383962] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-45f26561-dae0-4056-93af-b30eb5c24932" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.384116] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45f26561-dae0-4056-93af-b30eb5c24932',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.513821] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: SUCCESS [ 752.514086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.571300] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.680727] env[69656]: INFO networking_nsxv3.common.synchronization [req-563dc994-5822-4fa3-85cd-c51cc2bc1898 req-133ca5da-b950-4b9d-9748-bbd94256d59b tempest-ServersNegativeTestMultiTenantJSON-689681098 tempest-ServersNegativeTestMultiTenantJSON-689681098-project-member] Enqueued Resource ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b with Priority: HIGHEST for action security_group_members [ 752.681402] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b with Priority: HIGHEST for action security_group_members [ 752.681792] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-31cf519f-28de-486a-adaf-2d0102b1bc5b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.681949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.682049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.682302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.682501] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.682628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.682712] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.682897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.683012] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.683140] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31cf519f-28de-486a-adaf-2d0102b1bc5b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.886752] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.887132] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.887346] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.887754] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.887963] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.888396] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 45f26561-dae0-4056-93af-b30eb5c24932 not found, creating... [ 752.888729] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.888998] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.889707] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.889707] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.889816] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.890365] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.890518] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.890749] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.891120] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.891387] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.891524] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 45f26561-dae0-4056-93af-b30eb5c24932 is going to be created. [ 752.911626] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.911917] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.911995] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.912212] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.912633] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.912741] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-45f26561-dae0-4056-93af-b30eb5c24932" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.078616] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.078616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.078616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.078616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.078616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.078616] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be created. [ 753.113032] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.113032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.113032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.113032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.113505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.122565] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: UNINITIALIZED for 2s [ 753.185295] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.185457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.185524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.185741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.185901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.186614] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.186735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.186801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.186969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.187066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.187155] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b is going to be updated. [ 753.233186] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.233328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.233402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.233572] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.233714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.244314] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b in Status: IN_PROGRESS for 2s [ 753.814480] env[69656]: INFO networking_nsxv3.common.synchronization [req-21b9b9e5-be9d-4cae-82e9-db580cae6eb8 req-79940bf0-ed46-471c-8be5-a2f6c12a29cb service nova] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_rules [ 753.814596] env[69656]: INFO networking_nsxv3.common.synchronization [req-21b9b9e5-be9d-4cae-82e9-db580cae6eb8 req-79940bf0-ed46-471c-8be5-a2f6c12a29cb service nova] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 753.814736] env[69656]: INFO networking_nsxv3.common.synchronization [req-21b9b9e5-be9d-4cae-82e9-db580cae6eb8 req-79940bf0-ed46-471c-8be5-a2f6c12a29cb service nova] Enqueued Resource ID: 45f26561-dae0-4056-93af-b30eb5c24932 with Priority: HIGHEST for action port [ 753.814974] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_rules [ 753.815116] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 753.815212] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45f26561-dae0-4056-93af-b30eb5c24932 with Priority: HIGHEST for action port [ 753.815791] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.816041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.816130] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.816188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.816382] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-45f26561-dae0-4056-93af-b30eb5c24932 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.816505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45f26561-dae0-4056-93af-b30eb5c24932" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.816570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45f26561-dae0-4056-93af-b30eb5c24932" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.816865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45f26561-dae0-4056-93af-b30eb5c24932" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.816925] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45f26561-dae0-4056-93af-b30eb5c24932',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.183147] env[69656]: INFO networking_nsxv3.common.synchronization [req-cbe22a5f-19be-40ca-96dc-470c37213862 req-527d1be7-c876-4757-bdf7-1806fd680d7e tempest-DeleteServersAdminTestJSON-1062874263 tempest-DeleteServersAdminTestJSON-1062874263-project-member] Enqueued Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_members [ 754.183147] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_members [ 754.183147] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.183147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.183147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.183147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.185523] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.185967] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.186137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.186386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.186558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.186832] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.246349] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc in Status: SUCCESS [ 754.246349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.319177] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45f26561-dae0-4056-93af-b30eb5c24932 with status ACTIVE [ 754.319410] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.319548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.319615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.319841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.319933] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.320127] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.320229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.320291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.320450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.320529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.320704] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.320795] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.320857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.320998] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.321104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.321166] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45f26561-dae0-4056-93af-b30eb5c24932 is going to be updated. [ 754.342666] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.342826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.342887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.343121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.343253] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.343413] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45f26561-dae0-4056-93af-b30eb5c24932" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.567404] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-315 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.567404] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.567404] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.567404] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.567404] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.567404] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.567404] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.567404] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.567404] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.567404] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.567404] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.567851] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.567851] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.567851] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.567851] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.567962] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.585515] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.585667] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 754.585826] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.586057] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.586386] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-e0c6872d-d572-4214-bbd3-e61136a6709f taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.586583] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-e0c6872d-d572-4214-bbd3-e61136a6709f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.586736] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-e0c6872d-d572-4214-bbd3-e61136a6709f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.587082] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-e0c6872d-d572-4214-bbd3-e61136a6709f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.590519] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0c6872d-d572-4214-bbd3-e61136a6709f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.692298] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.692476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.692555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.692813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.692920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.693130] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.693229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.693291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.693440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.693515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.693597] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb is going to be updated. [ 754.721891] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.722055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.722127] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.722342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.722482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.731754] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: IN_PROGRESS for 2s [ 754.886803] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.886979] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.887121] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.887390] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.887647] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.887809] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.887932] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.888463] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.888747] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.890305] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.890305] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.890305] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.890305] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.890305] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.890305] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.890305] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.907861] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.907976] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 754.908151] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.908415] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.908855] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.909112] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.909274] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.909590] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.909770] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.089561] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.089853] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.089990] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.090277] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.090430] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.090597] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port e0c6872d-d572-4214-bbd3-e61136a6709f not found, creating... [ 755.090856] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.091023] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.091144] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.091354] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.091503] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.091768] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.091924] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.094077] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.094447] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.094740] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.095038] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: e0c6872d-d572-4214-bbd3-e61136a6709f is going to be created. [ 755.115583] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.115801] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.115922] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.116226] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.116497] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.116787] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-e0c6872d-d572-4214-bbd3-e61136a6709f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.137758] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 755.138726] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.138991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.139215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.139411] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.139533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.139599] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.139762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.139863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.139951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.140061] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.144192] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.144379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.144551] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.144660] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.144724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.144867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.144986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.145055] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.255078] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b in Status: SUCCESS [ 755.255266] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b deletion is rescheduled due to dependency. [ 755.255343] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.412909] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.413148] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.413274] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.413554] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.413703] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.413857] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf not found, creating... [ 755.414133] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.414293] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.414409] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.414632] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.414769] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.419233] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.419656] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.419656] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.419821] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.420046] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.420205] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf is going to be created. [ 755.439030] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.439258] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.439381] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.439650] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.439895] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.440164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.645573] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.645738] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.647244] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.874023] env[69656]: INFO networking_nsxv3.common.synchronization [req-21b9b9e5-be9d-4cae-82e9-db580cae6eb8 req-eeeed327-2fcf-4ba0-9757-a90c3533d619 service nova] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_rules [ 755.874023] env[69656]: INFO networking_nsxv3.common.synchronization [req-21b9b9e5-be9d-4cae-82e9-db580cae6eb8 req-eeeed327-2fcf-4ba0-9757-a90c3533d619 service nova] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 755.874023] env[69656]: INFO networking_nsxv3.common.synchronization [req-21b9b9e5-be9d-4cae-82e9-db580cae6eb8 req-eeeed327-2fcf-4ba0-9757-a90c3533d619 service nova] Enqueued Resource ID: e0c6872d-d572-4214-bbd3-e61136a6709f with Priority: HIGHEST for action port [ 755.874023] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_rules [ 755.879017] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 755.879017] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c6872d-d572-4214-bbd3-e61136a6709f with Priority: HIGHEST for action port [ 755.879017] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.879017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.879017] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.879017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.879017] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0c6872d-d572-4214-bbd3-e61136a6709f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.879017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0c6872d-d572-4214-bbd3-e61136a6709f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.879017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0c6872d-d572-4214-bbd3-e61136a6709f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.879017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0c6872d-d572-4214-bbd3-e61136a6709f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.879017] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0c6872d-d572-4214-bbd3-e61136a6709f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.149643] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.381666] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0c6872d-d572-4214-bbd3-e61136a6709f with status ACTIVE [ 756.382048] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.382161] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.382161] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.382359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.382451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.382633] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.382732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.382794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.382942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.383031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.383211] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.383325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.383388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.383529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.383604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.383689] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0c6872d-d572-4214-bbd3-e61136a6709f is going to be updated. [ 756.405845] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.405845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.405845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.405845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.405845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.405845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0c6872d-d572-4214-bbd3-e61136a6709f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.651893] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.652091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.652164] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.652397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.652493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.652605] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be updated. [ 756.679499] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.679499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.679499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.679722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.680372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.690065] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: IN_PROGRESS for 2s [ 756.691576] env[69656]: INFO networking_nsxv3.common.synchronization [req-cbe22a5f-19be-40ca-96dc-470c37213862 req-1cdab04d-8ae8-4ead-b300-2303c2ad168d service nova] Enqueued Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_rules [ 756.691740] env[69656]: INFO networking_nsxv3.common.synchronization [req-cbe22a5f-19be-40ca-96dc-470c37213862 req-1cdab04d-8ae8-4ead-b300-2303c2ad168d service nova] Enqueued Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_members [ 756.691873] env[69656]: INFO networking_nsxv3.common.synchronization [req-cbe22a5f-19be-40ca-96dc-470c37213862 req-1cdab04d-8ae8-4ead-b300-2303c2ad168d service nova] Enqueued Resource ID: f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf with Priority: HIGHEST for action port [ 756.692103] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_rules [ 756.692665] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_members [ 756.692665] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf with Priority: HIGHEST for action port [ 756.692866] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.693050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.693983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.693983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.693983] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.698024] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.698024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.698024] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.698024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.698024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.698024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.698024] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.742864] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: SUCCESS [ 756.743098] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb deletion is rescheduled due to dependency. [ 756.743344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.743790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.744059] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.744278] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.744416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.744505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.744691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.744812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.744926] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.199018] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.199018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.199018] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf with status ACTIVE [ 757.199018] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.199018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.199018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.199018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.199018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.199018] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.199751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.199751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.199751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.199751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.199751] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.200010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.200010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.200161] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.200240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.200329] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf is going to be updated. [ 757.220932] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.221100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.221174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.221370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.221504] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.221663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1cbe4bc-0ca7-47d8-8a67-db6b4656f3cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.248342] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.750968] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.255365] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.255557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.257573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.257573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.257573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.257573] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb is going to be updated. [ 758.283417] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.283558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.285519] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.285519] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.285519] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.292403] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: IN_PROGRESS for 2s [ 758.702919] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 758.703167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.703356] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.703557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.703746] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.703867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.703957] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.704133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.704213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.704303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.704467] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.704552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.704613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.704753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.704892] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.704989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.710025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.710025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.710025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.710025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.710025] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.710025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.710025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.710025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.710025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.710025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.710025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.710025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.710025] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.212526] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.213510] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fcdf0196-2f66-4c44-9bd4-b05de185002c: rpc.has_security_group_logging(os_id): False [ 759.233963] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.234335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.234465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.234708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.236419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.236419] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.236419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.236419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.236419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.236419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.236419] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.236419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.236419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.236419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.236419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.236419] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.236419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.236419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.236861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.236861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.236861] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be created. [ 759.304926] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.305173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.305173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.305391] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.305587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.318372] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: IN_PROGRESS for 2s [ 759.668705] env[69656]: INFO networking_nsxv3.common.synchronization [None req-59453d59-2a11-4ff3-afda-e93c5bfa7ef5 tempest-MigrationsAdminTest-978699219 tempest-MigrationsAdminTest-978699219-project-member] Enqueued Resource ID: b11ef70e-e305-4e27-b447-f3ccf5cb755f with Priority: HIGHEST for action security_group_rules [ 759.668943] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11ef70e-e305-4e27-b447-f3ccf5cb755f with Priority: HIGHEST for action security_group_rules [ 759.669348] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b11ef70e-e305-4e27-b447-f3ccf5cb755f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.669348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b11ef70e-e305-4e27-b447-f3ccf5cb755f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.669348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b11ef70e-e305-4e27-b447-f3ccf5cb755f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.669550] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b11ef70e-e305-4e27-b447-f3ccf5cb755f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.669867] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b11ef70e-e305-4e27-b447-f3ccf5cb755f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.715249] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.768810] env[69656]: INFO networking_nsxv3.common.synchronization [None req-78298156-3fc2-4513-84d8-843b61d91511 tempest-MigrationsAdminTest-978699219 tempest-MigrationsAdminTest-978699219-project-member] Enqueued Resource ID: b11ef70e-e305-4e27-b447-f3ccf5cb755f with Priority: HIGHEST for action security_group_rules [ 759.769538] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11ef70e-e305-4e27-b447-f3ccf5cb755f with Priority: HIGHEST for action security_group_rules [ 759.769935] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b11ef70e-e305-4e27-b447-f3ccf5cb755f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.769935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b11ef70e-e305-4e27-b447-f3ccf5cb755f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.196065] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.196065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.196065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.196065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.196065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.196065] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b11ef70e-e305-4e27-b447-f3ccf5cb755f already deleted. [ 760.196065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b11ef70e-e305-4e27-b447-f3ccf5cb755f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.196065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b11ef70e-e305-4e27-b447-f3ccf5cb755f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.196065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b11ef70e-e305-4e27-b447-f3ccf5cb755f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.196065] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b11ef70e-e305-4e27-b447-f3ccf5cb755f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.220582] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.220582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.220582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.220582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.220582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.220582] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be updated. [ 760.247058] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.247506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.247630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.247879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.248093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.256845] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: IN_PROGRESS for 2s [ 760.302228] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: SUCCESS [ 760.302502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.302697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.302818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.303018] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.303372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.303372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.303372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.303497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.303497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.303595] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.717278] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.717278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.717278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.717278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.717278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.717278] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b11ef70e-e305-4e27-b447-f3ccf5cb755f already deleted. [ 760.717278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b11ef70e-e305-4e27-b447-f3ccf5cb755f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.788812] env[69656]: INFO networking_nsxv3.common.synchronization [req-1e6a6dbb-88a1-4709-8d37-550f56c8a3f1 req-3096a4e4-fccc-4472-a8d8-8efb3284b9df tempest-ImagesNegativeTestJSON-284269330 tempest-ImagesNegativeTestJSON-284269330-project-member] Enqueued Resource ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc with Priority: HIGHEST for action security_group_members [ 760.791123] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc with Priority: HIGHEST for action security_group_members [ 760.793828] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-45271c60-03cb-4886-a9a6-d3916a12e9bc taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.794642] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.794642] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.794642] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.794892] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.794892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.794973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.795583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.795583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.795583] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45271c60-03cb-4886-a9a6-d3916a12e9bc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.806233] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.806233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.806405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.807673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.807930] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.808313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.808313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.808558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.808708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.808866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.809128] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.809441] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.809441] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.809608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.809830] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.810120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.810120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.810454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.810454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.810568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.811059] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.849230] env[69656]: INFO networking_nsxv3.common.synchronization [req-76e22c8b-121d-4425-a55b-769c2325abda req-83d34fd1-3cd8-4f5c-a38f-689e3d82aec1 tempest-ListServersNegativeTestJSON-1654090398 tempest-ListServersNegativeTestJSON-1654090398-project-member] Enqueued Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 760.849989] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 760.850386] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.850512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.850636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.852265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.852265] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.852265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.852265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.852265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.852265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.852265] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.251867] env[69656]: INFO networking_nsxv3.common.synchronization [req-53e487aa-9417-4ab2-a288-64c1043df5f2 req-d1d37a0a-540f-4fbe-8acd-f6a7e0e88dc0 tempest-FloatingIPsAssociationTestJSON-1340927557 tempest-FloatingIPsAssociationTestJSON-1340927557-project-member] Enqueued Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_members [ 761.252866] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_members [ 761.253308] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.253554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.253694] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.254175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.254409] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.254606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.254740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.254972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.255160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.255324] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.304029] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.304029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.304029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.304029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.304029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.304029] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.304029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.304029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.304029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.304029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.304029] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc is going to be updated. [ 761.313906] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb: rpc.has_security_group_logging(os_id): False [ 761.334467] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.334668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.334716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.334926] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.335034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.335276] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.335375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.335436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.335591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.335666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.336442] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.336911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.337046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.337258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.337529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.337615] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.337755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.337853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.338053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.338183] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.338307] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb is going to be updated. [ 761.340597] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 761.341157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.341907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.342450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.342674] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.344908] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.345558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.345693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.345943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.346493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.355143] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.356710] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc in Status: IN_PROGRESS for 2s [ 761.404395] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.404598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.404684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.404956] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.405203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.417023] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: IN_PROGRESS for 2s [ 761.423515] env[69656]: INFO networking_nsxv3.common.synchronization [req-002bc3c2-eb25-484c-9812-7696739a0d1e req-1b696589-ab86-455a-a0b3-dfa92bfe237a tempest-ListServersNegativeTestJSON-1654090398 tempest-ListServersNegativeTestJSON-1654090398-project-member] Enqueued Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 761.424169] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGHEST for action security_group_members [ 761.424539] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.424681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.758883] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.848892] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.849131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.864375] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.264653] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.268196] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 762.268426] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.268672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.269219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.269498] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.269664] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.269733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.269962] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.270090] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.270195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.270286] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.367180] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.367328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.367403] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.367622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.367714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.367810] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f636061-691e-4a7a-a595-1723a2745695 is going to be updated. [ 762.410852] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.410994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.411110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.411357] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.411499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.423685] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: IN_PROGRESS for 2s [ 762.768563] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.768702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.768760] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.769163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.769345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.769475] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97579684-a77f-4bf3-9586-742120a2eca4 is going to be updated. [ 762.772219] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.773436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.773436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.773436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.773436] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.773436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.773436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.773436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.773436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.773436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.773436] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.774022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.774022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.774022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.774022] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.774022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.774173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.774173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.774811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.774811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.774811] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.795357] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.795492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.795565] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.795765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.795906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.804636] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: IN_PROGRESS for 2s [ 763.278246] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fcdf0196-2f66-4c44-9bd4-b05de185002c: rpc.has_security_group_logging(os_id): False [ 763.299420] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.299615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.299658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.299835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.299959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.300647] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.300647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.300647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.300647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.300647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.301108] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.301108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.301108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.301108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.301108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.301315] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.301378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.301415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.301551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.301645] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.301693] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be updated. [ 763.368931] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.369311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.369461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.369719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.369892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.371799] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc in Status: SUCCESS [ 763.371996] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc deletion is rescheduled due to dependency. [ 763.372374] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.385575] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: IN_PROGRESS for 2s [ 763.435147] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: SUCCESS [ 763.435369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.515502] env[69656]: INFO networking_nsxv3.common.synchronization [req-1387f5c7-f4d1-487a-a449-587750cb6b64 req-396bc2ff-b105-474f-ac6c-05ff86f21f40 tempest-AttachInterfacesV270Test-782615226 tempest-AttachInterfacesV270Test-782615226-project-member] Enqueued Resource ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 with Priority: HIGHEST for action security_group_members [ 763.517364] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 with Priority: HIGHEST for action security_group_members [ 763.517364] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c789852-e0f1-466f-87e6-4a1aee8710c0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.517364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.517364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.517364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.521287] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.521461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.521560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.521702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.521816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.521979] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c789852-e0f1-466f-87e6-4a1aee8710c0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.026659] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.026659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.026659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.026659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.026659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.026659] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.026659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.026659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.026659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.026659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.026659] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 already deleted. [ 764.026659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.159611] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.159611] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-548" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.159611] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-548" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.159611] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-548" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.159611] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.159611] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.159611] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.159611] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.159611] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.159611] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.160632] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.160632] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.160632] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.160632] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.160632] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.160831] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.187863] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.189263] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 764.189501] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.190340] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-548" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.190689] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.190883] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.191092] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.191467] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.191641] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.397395] env[69656]: INFO networking_nsxv3.common.synchronization [req-c388f1bc-8a42-4820-847e-5c0843b6c6a5 req-a53aaab4-0766-4414-b8f5-9420a62b9d27 tempest-ImagesOneServerNegativeTestJSON-384940824 tempest-ImagesOneServerNegativeTestJSON-384940824-project-member] Enqueued Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 764.398077] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 764.398618] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.398864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.398864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.399140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.399336] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.399489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.399588] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.399762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.399860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.399949] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.435147] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: SUCCESS [ 764.436242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.436242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.436487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.436677] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.437668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.437668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.437668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.437668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.437668] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.694315] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.694671] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.694851] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.695214] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.695412] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.695590] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed not found, creating... [ 764.695917] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.696339] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.696339] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.696620] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.697295] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.697661] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.697881] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.698042] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.698294] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.698462] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.698631] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed is going to be created. [ 764.720910] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.720910] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.720910] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.720910] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.720910] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.721273] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.814886] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: SUCCESS [ 764.815133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.902632] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.902812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.903092] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.903092] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.903214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.903389] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.903489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.903583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.903989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.903989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.903989] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf is going to be updated. [ 764.937567] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.943423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.943423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.943423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.943423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.943746] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.943987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.944150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.944465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.944622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.944898] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.945156] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.945305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.945542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.945917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.946111] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f636061-691e-4a7a-a595-1723a2745695 is going to be updated. [ 764.955940] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: IN_PROGRESS for 2s [ 764.969828] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.970612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.973199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.973199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.973199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.979437] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: IN_PROGRESS for 2s [ 765.401111] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 765.401478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.401799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.402647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.402785] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.789807] env[69656]: INFO networking_nsxv3.common.synchronization [None req-2ea57081-6f55-44ea-90cb-67f842fe9847 None None] Enqueued Resource ID: c862ce74-1833-49ae-b10c-ff11870bed5c with Priority: HIGHEST for action port [ 765.789807] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c862ce74-1833-49ae-b10c-ff11870bed5c with Priority: HIGHEST for action port [ 765.790512] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-c862ce74-1833-49ae-b10c-ff11870bed5c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.790935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c862ce74-1833-49ae-b10c-ff11870bed5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.790935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c862ce74-1833-49ae-b10c-ff11870bed5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.790935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c862ce74-1833-49ae-b10c-ff11870bed5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.790935] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c862ce74-1833-49ae-b10c-ff11870bed5c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.856923] env[69656]: INFO networking_nsxv3.common.synchronization [req-1387f5c7-f4d1-487a-a449-587750cb6b64 req-edfb8be4-ffc0-4d55-9fc1-f8ede554861f service nova] Enqueued Resource ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 with Priority: HIGHEST for action security_group_rules [ 765.857167] env[69656]: INFO networking_nsxv3.common.synchronization [req-1387f5c7-f4d1-487a-a449-587750cb6b64 req-edfb8be4-ffc0-4d55-9fc1-f8ede554861f service nova] Enqueued Resource ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 with Priority: HIGHEST for action security_group_members [ 765.857303] env[69656]: INFO networking_nsxv3.common.synchronization [req-1387f5c7-f4d1-487a-a449-587750cb6b64 req-edfb8be4-ffc0-4d55-9fc1-f8ede554861f service nova] Enqueued Resource ID: cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed with Priority: HIGHEST for action port [ 765.857554] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 with Priority: HIGHEST for action security_group_rules [ 765.857682] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 with Priority: HIGHEST for action security_group_members [ 765.857776] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed with Priority: HIGHEST for action port [ 765.858655] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c789852-e0f1-466f-87e6-4a1aee8710c0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.858802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.858884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.859143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.859227] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c789852-e0f1-466f-87e6-4a1aee8710c0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.860092] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c789852-e0f1-466f-87e6-4a1aee8710c0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.860203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.860270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.860434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.860620] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.862186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.862186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.862186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.862186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.862186] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c789852-e0f1-466f-87e6-4a1aee8710c0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.864806] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.864806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.864806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.864806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.864806] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.907247] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.907247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.907247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.907247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.907247] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.907247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.907247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.907247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.907247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.907247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.907247] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.299058] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c862ce74-1833-49ae-b10c-ff11870bed5c [ 766.299058] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.299058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.299058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.299058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.299058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.299058] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c862ce74-1833-49ae-b10c-ff11870bed5c already deleted. [ 766.299058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c862ce74-1833-49ae-b10c-ff11870bed5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.355921] env[69656]: INFO networking_nsxv3.common.synchronization [req-e942bb2e-d082-439e-8a2a-b777b8f551e8 req-3e75ea09-461e-455c-b5b4-3c0ff4b80766 tempest-MultipleCreateTestJSON-62297241 tempest-MultipleCreateTestJSON-62297241-project-member] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 766.356836] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 766.357424] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.357710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.357780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.358498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.358757] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.358884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.358969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.363654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.363654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.363654] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.364670] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c789852-e0f1-466f-87e6-4a1aee8710c0 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.364770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.364934] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c789852-e0f1-466f-87e6-4a1aee8710c0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.366813] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed with status ACTIVE [ 766.366991] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.367115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.367179] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.367364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.367450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.367617] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.367709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.367767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.367927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.367978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.368166] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.368257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.368316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.368451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.368525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.368607] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed is going to be updated. [ 766.391141] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.391141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.391141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.391141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.391141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.391530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbd70ef9-2b62-4fe8-a30d-e77d5d8ad0ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.418435] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.418435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.418435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.418435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.418435] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.418435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.418435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.418435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.418435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.418435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.418435] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.418435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.418435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.418435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.418435] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.418435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.420708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.420708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.420708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.420708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.420708] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.870692] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.870922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.870922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.871227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.871357] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.871480] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.875193] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.875517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.875572] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.876531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.876531] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 already deleted. [ 766.876531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.876531] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c789852-e0f1-466f-87e6-4a1aee8710c0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.923674] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fcdf0196-2f66-4c44-9bd4-b05de185002c: rpc.has_security_group_logging(os_id): False [ 766.942228] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.942457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.942527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.942744] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.942835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.943080] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.945037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.945037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.945037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.945037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.945037] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.945037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.945037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.945037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.945037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.945037] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.945037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.945037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.945037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.945037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.945037] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be updated. [ 766.973742] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: SUCCESS [ 766.973911] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf deletion is rescheduled due to dependency. [ 766.974137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.988425] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f636061-691e-4a7a-a595-1723a2745695 in Status: SUCCESS [ 766.988644] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f636061-691e-4a7a-a595-1723a2745695 deletion is rescheduled due to dependency. [ 766.988764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.033302] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.033446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.033503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.033712] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.033847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.055946] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: IN_PROGRESS for 2s [ 767.100500] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-133 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.100729] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.100859] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.101854] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.101854] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.101854] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.101854] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.102426] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.103115] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.103115] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.103115] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.103363] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.103363] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.103363] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.103482] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.103602] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.134616] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.134806] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 767.134962] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.136276] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.136276] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-ac70f573-d20e-4cd2-a2c7-e577aaf44f44 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.136276] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-ac70f573-d20e-4cd2-a2c7-e577aaf44f44" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.136276] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-ac70f573-d20e-4cd2-a2c7-e577aaf44f44" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.136276] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-ac70f573-d20e-4cd2-a2c7-e577aaf44f44" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.136551] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac70f573-d20e-4cd2-a2c7-e577aaf44f44',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.381473] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.381473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.381473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.381473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.381473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.381473] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 is going to be created. [ 767.408515] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.408831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.408831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.409191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.409372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.419700] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 in Status: UNINITIALIZED for 2s [ 767.643066] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.643066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.643066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.643066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.643066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.643066] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port ac70f573-d20e-4cd2-a2c7-e577aaf44f44 not found, creating... [ 767.643066] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.643066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.643066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.643066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.643066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.643671] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.643671] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.643671] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.643671] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.643671] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.643671] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: ac70f573-d20e-4cd2-a2c7-e577aaf44f44 is going to be created. [ 767.665289] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.665289] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.665289] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.665289] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.665289] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.665289] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-ac70f573-d20e-4cd2-a2c7-e577aaf44f44" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.327848] env[69656]: INFO networking_nsxv3.common.synchronization [None req-68416076-71bc-4f86-b01c-332ecc5d7c19 None None] Enqueued Resource ID: e0735baa-e55f-456d-89a3-dabc2ab9bed5 with Priority: HIGHEST for action port [ 768.327848] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0735baa-e55f-456d-89a3-dabc2ab9bed5 with Priority: HIGHEST for action port [ 768.327848] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0735baa-e55f-456d-89a3-dabc2ab9bed5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.327848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0735baa-e55f-456d-89a3-dabc2ab9bed5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.327848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0735baa-e55f-456d-89a3-dabc2ab9bed5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.327848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0735baa-e55f-456d-89a3-dabc2ab9bed5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.327848] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0735baa-e55f-456d-89a3-dabc2ab9bed5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.703460] env[69656]: INFO networking_nsxv3.common.synchronization [req-e942bb2e-d082-439e-8a2a-b777b8f551e8 req-2bfe446c-bd62-4b95-b1db-de9e8ad80d1b service nova] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_rules [ 768.703688] env[69656]: INFO networking_nsxv3.common.synchronization [req-e942bb2e-d082-439e-8a2a-b777b8f551e8 req-2bfe446c-bd62-4b95-b1db-de9e8ad80d1b service nova] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 768.703914] env[69656]: INFO networking_nsxv3.common.synchronization [req-e942bb2e-d082-439e-8a2a-b777b8f551e8 req-2bfe446c-bd62-4b95-b1db-de9e8ad80d1b service nova] Enqueued Resource ID: ac70f573-d20e-4cd2-a2c7-e577aaf44f44 with Priority: HIGHEST for action port [ 768.704370] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_rules [ 768.704537] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 768.704638] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac70f573-d20e-4cd2-a2c7-e577aaf44f44 with Priority: HIGHEST for action port [ 768.709107] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.709107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.709107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.709107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.709107] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.709107] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.709107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.709107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.709107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.709107] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.709107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.709107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.709107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.709107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.709107] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.711759] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac70f573-d20e-4cd2-a2c7-e577aaf44f44 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.711984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac70f573-d20e-4cd2-a2c7-e577aaf44f44" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.712158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac70f573-d20e-4cd2-a2c7-e577aaf44f44" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.712394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac70f573-d20e-4cd2-a2c7-e577aaf44f44" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.712545] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac70f573-d20e-4cd2-a2c7-e577aaf44f44',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.831286] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0735baa-e55f-456d-89a3-dabc2ab9bed5 [ 768.831504] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.831638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.831704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.831952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.832054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.832150] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0735baa-e55f-456d-89a3-dabc2ab9bed5 already deleted. [ 768.832226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0735baa-e55f-456d-89a3-dabc2ab9bed5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.901505] env[69656]: INFO networking_nsxv3.common.synchronization [None req-fd018ada-770a-4036-8ee0-044f2c4f083e None None] Enqueued Resource ID: 12b34ef8-abb1-4c58-a3b2-9ea1735bd6ab with Priority: HIGHEST for action port [ 768.902062] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12b34ef8-abb1-4c58-a3b2-9ea1735bd6ab with Priority: HIGHEST for action port [ 768.902371] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-12b34ef8-abb1-4c58-a3b2-9ea1735bd6ab taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.902486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12b34ef8-abb1-4c58-a3b2-9ea1735bd6ab" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.902550] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12b34ef8-abb1-4c58-a3b2-9ea1735bd6ab" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.902798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12b34ef8-abb1-4c58-a3b2-9ea1735bd6ab" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.902908] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12b34ef8-abb1-4c58-a3b2-9ea1735bd6ab',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.953543] env[69656]: INFO networking_nsxv3.common.synchronization [req-e942bb2e-d082-439e-8a2a-b777b8f551e8 req-d2a25dfd-e1e0-4945-95fe-46f13b7a619f tempest-MultipleCreateTestJSON-62297241 tempest-MultipleCreateTestJSON-62297241-project-member] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 768.954369] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 768.954870] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.954870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.142286] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 769.142601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.214382] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.214456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.214656] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.217197] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac70f573-d20e-4cd2-a2c7-e577aaf44f44 with status ACTIVE [ 769.217398] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.217520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.217586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.217798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.217884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.218081] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.218216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.218247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.218495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.218495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.218620] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.218733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.218791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.218961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.219046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.219134] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac70f573-d20e-4cd2-a2c7-e577aaf44f44 is going to be updated. [ 769.242411] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.244393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.244393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.244393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.244393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.244393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac70f573-d20e-4cd2-a2c7-e577aaf44f44" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.316832] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-133 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.316832] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.316832] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.316832] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.317156] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.317268] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.317376] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.317588] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.317732] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.318700] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 769.318854] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 769.319061] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 769.319188] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 769.319309] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 769.319417] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 769.319551] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 769.342927] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 769.342927] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 769.343114] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 769.343534] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.344248] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-a4e9c91a-2eba-4c98-88b1-f1da765fce62 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.344248] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-a4e9c91a-2eba-4c98-88b1-f1da765fce62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.344248] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-a4e9c91a-2eba-4c98-88b1-f1da765fce62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.344722] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-a4e9c91a-2eba-4c98-88b1-f1da765fce62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.344722] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4e9c91a-2eba-4c98-88b1-f1da765fce62',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.405220] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12b34ef8-abb1-4c58-a3b2-9ea1735bd6ab [ 769.405452] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.406201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.406201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.406201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.406201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.406201] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12b34ef8-abb1-4c58-a3b2-9ea1735bd6ab already deleted. [ 769.406201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12b34ef8-abb1-4c58-a3b2-9ea1735bd6ab" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.429933] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 in Status: SUCCESS [ 769.432996] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.432996] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.432996] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.432996] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.432996] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.432996] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.432996] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.432996] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.432996] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.432996] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c789852-e0f1-466f-87e6-4a1aee8710c0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.556736] env[69656]: INFO networking_nsxv3.common.synchronization [req-96bdce3e-0fa3-4756-aba7-a929e4ae0877 req-315af18e-562b-468d-8752-6eb46c7d3c95 tempest-ServersTestMultiNic-506331318 tempest-ServersTestMultiNic-506331318-project-member] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 769.558074] env[69656]: INFO networking_nsxv3.common.synchronization [req-cb952291-1db0-48e3-97d9-558d2a67afd8 req-414974b1-fabe-4877-899b-2dd6053a6338 tempest-DeleteServersAdminTestJSON-1062874263 tempest-DeleteServersAdminTestJSON-1062874263-project-member] Enqueued Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_members [ 769.558772] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 769.558942] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb with Priority: HIGHEST for action security_group_members [ 769.559304] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.559429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.559557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.559807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.559966] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.560307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.560428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.560591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.560707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.561131] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.561795] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.561913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.561984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.562268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.562396] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.562494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.562555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.562692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.562775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.562862] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a9ee1b5-46c4-4ea5-a724-f697a2014dcb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.717105] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.847889] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.848222] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.848367] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.848720] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.848901] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.849147] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port a4e9c91a-2eba-4c98-88b1-f1da765fce62 not found, creating... [ 769.849464] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.849639] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.849803] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.850104] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.850288] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.850638] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.850812] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.850934] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.851232] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.851389] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.851552] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: a4e9c91a-2eba-4c98-88b1-f1da765fce62 is going to be created. [ 769.872659] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.873450] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.873450] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.873450] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.873569] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.873703] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-a4e9c91a-2eba-4c98-88b1-f1da765fce62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.935842] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c789852-e0f1-466f-87e6-4a1aee8710c0 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.936015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.936088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.936382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.936542] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.936633] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.936702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.936846] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.936941] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.937180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.937368] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c789852-e0f1-466f-87e6-4a1aee8710c0 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.937472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.937538] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.937703] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.937838] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.937931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.937993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.938145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.938227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.938308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.938396] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c789852-e0f1-466f-87e6-4a1aee8710c0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.064415] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.065689] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.066616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.067421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.067421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.067421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.067421] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.067828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.067828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.067828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.067987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.067987] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb is going to be updated. [ 770.101209] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.102146] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.102146] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.102146] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.102146] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.110440] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: IN_PROGRESS for 2s [ 770.221972] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.222217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.222217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.223475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.223475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.223475] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be created. [ 770.249430] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.249666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.249666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.249881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.250099] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.262062] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: UNINITIALIZED for 2s [ 770.355048] env[69656]: INFO networking_nsxv3.common.synchronization [req-96bdce3e-0fa3-4756-aba7-a929e4ae0877 req-583d1e45-bc35-49e9-929e-956b54f86d5c tempest-ServersTestMultiNic-506331318 tempest-ServersTestMultiNic-506331318-project-member] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 770.355048] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 770.355048] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.355048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.442078] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c789852-e0f1-466f-87e6-4a1aee8710c0: rpc.has_security_group_logging(os_id): False [ 770.458993] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.459170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.459231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.459443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.459602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.459799] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.459896] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.460493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.460704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.460792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.461432] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.461432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.461432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.461432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.461432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.461656] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.461656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.461741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.461830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.461899] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.461992] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 is going to be created. [ 770.521306] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.521444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.521511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.521714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.521892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.532389] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 in Status: IN_PROGRESS for 2s [ 770.570347] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.606575] env[69656]: INFO networking_nsxv3.common.synchronization [req-e942bb2e-d082-439e-8a2a-b777b8f551e8 req-83fa18ab-0c4b-4d70-a346-9a2df2366391 service nova] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_rules [ 770.607596] env[69656]: INFO networking_nsxv3.common.synchronization [req-e942bb2e-d082-439e-8a2a-b777b8f551e8 req-83fa18ab-0c4b-4d70-a346-9a2df2366391 service nova] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 770.607596] env[69656]: INFO networking_nsxv3.common.synchronization [req-e942bb2e-d082-439e-8a2a-b777b8f551e8 req-83fa18ab-0c4b-4d70-a346-9a2df2366391 service nova] Enqueued Resource ID: a4e9c91a-2eba-4c98-88b1-f1da765fce62 with Priority: HIGHEST for action port [ 770.607596] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_rules [ 770.607596] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 770.607596] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4e9c91a-2eba-4c98-88b1-f1da765fce62 with Priority: HIGHEST for action port [ 770.608026] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.608124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.608312] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.608410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.608595] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4e9c91a-2eba-4c98-88b1-f1da765fce62 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.608670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4e9c91a-2eba-4c98-88b1-f1da765fce62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.608731] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4e9c91a-2eba-4c98-88b1-f1da765fce62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.608924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4e9c91a-2eba-4c98-88b1-f1da765fce62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.609027] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4e9c91a-2eba-4c98-88b1-f1da765fce62',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.704435] env[69656]: INFO networking_nsxv3.common.synchronization [req-96bdce3e-0fa3-4756-aba7-a929e4ae0877 req-04f53d22-5b55-4be9-bb1c-68794a127278 tempest-ServersTestMultiNic-506331318 tempest-ServersTestMultiNic-506331318-project-member] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 770.705080] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 770.705821] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.706075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.074628] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.074628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.074628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.074628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.074628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.074628] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be updated. [ 771.110615] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4e9c91a-2eba-4c98-88b1-f1da765fce62 with status ACTIVE [ 771.113668] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.113668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.113668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.113668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.113668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.113668] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.113668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.113668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.113668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.113668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.113668] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.113668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.113668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.113668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.113668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.113668] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4e9c91a-2eba-4c98-88b1-f1da765fce62 is going to be updated. [ 771.122448] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.122569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.122635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.122847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.122982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.131863] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: IN_PROGRESS for 2s [ 771.150165] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.150165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.150165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.150165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.150165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.150165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4e9c91a-2eba-4c98-88b1-f1da765fce62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.299957] env[69656]: INFO networking_nsxv3.common.synchronization [None req-76181aa0-4799-4d63-8ad9-fd6eb09bc19e None None] Enqueued Resource ID: 7428de51-9766-4014-a501-178eb18985b4 with Priority: HIGHEST for action port [ 771.302016] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7428de51-9766-4014-a501-178eb18985b4 with Priority: HIGHEST for action port [ 771.302016] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-7428de51-9766-4014-a501-178eb18985b4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.302016] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7428de51-9766-4014-a501-178eb18985b4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.302016] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7428de51-9766-4014-a501-178eb18985b4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.302016] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7428de51-9766-4014-a501-178eb18985b4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.302016] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7428de51-9766-4014-a501-178eb18985b4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.809021] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7428de51-9766-4014-a501-178eb18985b4 [ 771.809021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.809021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.809021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.809021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.809021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.809021] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7428de51-9766-4014-a501-178eb18985b4 already deleted. [ 771.809021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7428de51-9766-4014-a501-178eb18985b4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.122597] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb in Status: SUCCESS [ 772.122872] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a9ee1b5-46c4-4ea5-a724-f697a2014dcb deletion is rescheduled due to dependency. [ 772.122872] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a9ee1b5-46c4-4ea5-a724-f697a2014dcb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.271839] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: SUCCESS [ 772.272717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.272912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.273163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.273356] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.273472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.273551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.273682] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.273760] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.273852] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.544563] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 in Status: SUCCESS [ 772.544815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.779172] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.142148] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 773.142479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.142826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.143245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.143532] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.143788] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.144386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.147023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.147023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.147023] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.281970] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.647426] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.647640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.647690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.647869] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.647960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.648179] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.648274] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.648330] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.648465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.648538] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.648620] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be updated. [ 773.675243] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.675390] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.675456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.675649] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.676094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.685056] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: IN_PROGRESS for 2s [ 773.785614] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.785614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.785614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.785816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.786047] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.786047] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be updated. [ 773.818577] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.818577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.818577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.818577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.818577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.826367] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: IN_PROGRESS for 2s [ 775.694875] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 775.695162] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c deletion is rescheduled due to dependency. [ 775.695213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.695334] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.695572] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.695746] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.695862] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.695916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.696088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.696169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.696258] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.835559] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: SUCCESS [ 775.835772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.835940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.836180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.836375] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.836492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.836552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.836700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.836777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.836879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.837018] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.837845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.838017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.838178] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.838279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.838345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.838476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.838551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.838633] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.201884] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.201884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.201884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.201884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.201884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.201884] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.201884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.201884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.201884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.201884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.201884] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be updated. [ 776.228386] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.228543] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.228596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.228792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.228947] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.244285] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: IN_PROGRESS for 2s [ 776.297586] env[69656]: INFO networking_nsxv3.common.synchronization [req-ed4114fc-6e81-4ad7-8d6f-5461c1bbe8e1 req-5b567908-9086-49ea-87a8-43e105311c8e tempest-TenantUsagesTestJSON-872215049 tempest-TenantUsagesTestJSON-872215049-project-member] Enqueued Resource ID: c9050284-73b2-4fa6-becd-7f21223f038d with Priority: HIGHEST for action security_group_members [ 776.298193] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9050284-73b2-4fa6-becd-7f21223f038d with Priority: HIGHEST for action security_group_members [ 776.298492] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9050284-73b2-4fa6-becd-7f21223f038d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.298613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.298678] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.298928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.299127] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.299227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.299276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.299431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.299517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.299608] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9050284-73b2-4fa6-becd-7f21223f038d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.342263] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.342384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.342566] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.649532] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.649718] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.649839] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.650139] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.650397] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.650552] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.650666] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.650873] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.651087] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.651355] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.651409] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.651518] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.651624] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.651745] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.651828] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.651955] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.669923] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.670140] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.670303] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.670481] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.670784] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-4865ad55-f9d3-414b-b7c1-b268d957c1e4 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.670954] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-4865ad55-f9d3-414b-b7c1-b268d957c1e4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.671102] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-4865ad55-f9d3-414b-b7c1-b268d957c1e4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.671413] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-4865ad55-f9d3-414b-b7c1-b268d957c1e4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.671570] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4865ad55-f9d3-414b-b7c1-b268d957c1e4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.801614] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.801914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.801914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.802069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.802163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.802355] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.802452] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.802514] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.802705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.802733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.802812] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9050284-73b2-4fa6-becd-7f21223f038d already deleted. [ 776.802902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.845888] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.174041] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.174196] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.174244] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.174538] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.174802] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.174856] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 4865ad55-f9d3-414b-b7c1-b268d957c1e4 not found, creating... [ 777.175105] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.175261] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.175391] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.175614] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.175752] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.176040] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.176200] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.176315] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.176513] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.176696] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.176850] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 4865ad55-f9d3-414b-b7c1-b268d957c1e4 is going to be created. [ 777.201024] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.201024] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.201226] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.201526] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.201756] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.201981] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-4865ad55-f9d3-414b-b7c1-b268d957c1e4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.349445] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.349640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.349710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.349923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.350107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.350143] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be updated. [ 777.379078] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.379078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.379308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.379347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.379506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.389180] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: IN_PROGRESS for 2s [ 777.975707] env[69656]: INFO networking_nsxv3.common.synchronization [req-ed4114fc-6e81-4ad7-8d6f-5461c1bbe8e1 req-faf01f6a-907b-42db-b26f-c9990655f03b service nova] Enqueued Resource ID: c9050284-73b2-4fa6-becd-7f21223f038d with Priority: HIGHEST for action security_group_rules [ 777.975979] env[69656]: INFO networking_nsxv3.common.synchronization [req-ed4114fc-6e81-4ad7-8d6f-5461c1bbe8e1 req-faf01f6a-907b-42db-b26f-c9990655f03b service nova] Enqueued Resource ID: c9050284-73b2-4fa6-becd-7f21223f038d with Priority: HIGHEST for action security_group_members [ 777.975979] env[69656]: INFO networking_nsxv3.common.synchronization [req-ed4114fc-6e81-4ad7-8d6f-5461c1bbe8e1 req-faf01f6a-907b-42db-b26f-c9990655f03b service nova] Enqueued Resource ID: 4865ad55-f9d3-414b-b7c1-b268d957c1e4 with Priority: HIGHEST for action port [ 777.976573] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9050284-73b2-4fa6-becd-7f21223f038d with Priority: HIGHEST for action security_group_rules [ 777.976656] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9050284-73b2-4fa6-becd-7f21223f038d with Priority: HIGHEST for action security_group_members [ 777.976762] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4865ad55-f9d3-414b-b7c1-b268d957c1e4 with Priority: HIGHEST for action port [ 777.977096] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9050284-73b2-4fa6-becd-7f21223f038d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.977224] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.977291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.978711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.978711] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9050284-73b2-4fa6-becd-7f21223f038d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.980269] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9050284-73b2-4fa6-becd-7f21223f038d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.980269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.980269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.980269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.980269] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.980269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.980269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.980269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.980269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.980524] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9050284-73b2-4fa6-becd-7f21223f038d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.981015] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-4865ad55-f9d3-414b-b7c1-b268d957c1e4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.985938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4865ad55-f9d3-414b-b7c1-b268d957c1e4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.986054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4865ad55-f9d3-414b-b7c1-b268d957c1e4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.986234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4865ad55-f9d3-414b-b7c1-b268d957c1e4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.986312] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4865ad55-f9d3-414b-b7c1-b268d957c1e4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.257158] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 778.257339] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c deletion is rescheduled due to dependency. [ 778.257452] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.488262] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9050284-73b2-4fa6-becd-7f21223f038d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.489386] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9050284-73b2-4fa6-becd-7f21223f038d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.489510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.489757] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4865ad55-f9d3-414b-b7c1-b268d957c1e4 with status ACTIVE [ 778.489811] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.489887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.489935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.490204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.490379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.490613] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.490613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.490800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.490871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.490959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.491438] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.491798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.491798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.491798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.492033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.492099] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4865ad55-f9d3-414b-b7c1-b268d957c1e4 is going to be updated. [ 778.511631] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.511831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.511831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.512078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.512226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.512379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4865ad55-f9d3-414b-b7c1-b268d957c1e4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.910454] env[69656]: INFO networking_nsxv3.common.synchronization [req-07cee506-f5f4-4077-a0af-4d9d369e94ef req-0c67090f-701d-4560-8b6f-0df3f7b4f4b8 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 778.910999] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 778.911315] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.911437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.911505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.911754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.911913] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.912311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.912468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.912605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.912687] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.912781] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.994683] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9050284-73b2-4fa6-becd-7f21223f038d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.399104] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: SUCCESS [ 779.399403] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.399595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.399846] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.400075] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.400193] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.400280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.400469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.400565] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.400690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.400902] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.401054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.401966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.402180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.402499] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.402616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.402684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.402826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.402905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.402988] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.403082] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.415494] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.415494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.415733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.415733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.416574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.416574] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.416574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.416574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.416574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.416574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.420201] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 already deleted. [ 779.420201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.447943] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.448264] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-780" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.448497] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-780" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.448764] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-780" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.449175] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.449533] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.450045] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.451121] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.451121] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.451121] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.451121] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.451121] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.451391] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.451585] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.451870] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.452255] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.471867] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.473059] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 779.473059] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.473059] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-780" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.473301] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-af5ece60-accf-4d00-894b-8c83236f8c97 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.473376] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.473561] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.473788] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.473945] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af5ece60-accf-4d00-894b-8c83236f8c97',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.499630] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.499928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.500225] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.500532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.501159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.501462] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9050284-73b2-4fa6-becd-7f21223f038d is going to be created. [ 779.525309] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.525527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.525636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.527024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.527024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.537343] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9050284-73b2-4fa6-becd-7f21223f038d in Status: UNINITIALIZED for 2s [ 779.907859] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11735c24-7aeb-4be5-9e7b-07f4290bc8a6: rpc.has_security_group_logging(os_id): False [ 779.926769] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.926769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.926769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.926769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.926769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.926769] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.926769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.926769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.926769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.926769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.926769] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.926769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.927370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.927370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.927510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.927674] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.927773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.927828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.928449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.928449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.928449] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be created. [ 779.980603] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.981190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.981190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.981190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.981797] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.983524] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.983595] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.984604] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.984604] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.984604] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.984604] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port af5ece60-accf-4d00-894b-8c83236f8c97 not found, creating... [ 779.984604] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.985027] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.985560] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.985793] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.986319] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.986624] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.986783] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.987052] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.987303] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.987483] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.987654] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: af5ece60-accf-4d00-894b-8c83236f8c97 is going to be created. [ 779.990854] env[69656]: INFO networking_nsxv3.common.synchronization [req-5cc8061f-9ab5-421e-b1eb-4cf8e9093868 req-517c9766-4e62-4bac-a4ad-09ebbf3eb376 tempest-AttachInterfacesV270Test-782615226 tempest-AttachInterfacesV270Test-782615226-project-member] Enqueued Resource ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 with Priority: HIGHEST for action security_group_members [ 779.991725] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 with Priority: HIGHEST for action security_group_members [ 779.992053] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c789852-e0f1-466f-87e6-4a1aee8710c0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.992149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.992217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.992375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.992513] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.992610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.992677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.992826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.992928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.993099] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c789852-e0f1-466f-87e6-4a1aee8710c0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.997996] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: IN_PROGRESS for 2s [ 780.006407] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.006695] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.006878] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.007238] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.007622] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.007622] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.180071] env[69656]: INFO networking_nsxv3.common.synchronization [req-ac904cb4-028c-4f56-8d31-f3468398940b req-86756a0a-8847-4085-9b18-0294b8942d8f tempest-MultipleCreateTestJSON-62297241 tempest-MultipleCreateTestJSON-62297241-project-member] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 780.180745] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 780.181605] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.181756] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.181827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.182038] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.182246] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.182414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.182473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.182677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.182767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.182859] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.324698] env[69656]: INFO networking_nsxv3.common.synchronization [req-5cb3ec6c-3e0b-4688-8981-fccf0d41e2b3 req-1b54a9a8-3507-40e3-a5ce-d7b4c10f8c19 tempest-MultipleCreateTestJSON-62297241 tempest-MultipleCreateTestJSON-62297241-project-member] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 780.325555] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 780.325555] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.325730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.495440] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.495526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.495604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.498890] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.498994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.499385] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.499537] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.499606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.499778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.499859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.499952] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 is going to be updated. [ 780.527096] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.527971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.527971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.527971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.527971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.537207] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 in Status: IN_PROGRESS for 2s [ 780.685953] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.876353] env[69656]: INFO networking_nsxv3.common.synchronization [req-07cee506-f5f4-4077-a0af-4d9d369e94ef req-5ca8303d-ff71-47e7-b2b4-727ae210d70a service nova] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_rules [ 780.876353] env[69656]: INFO networking_nsxv3.common.synchronization [req-07cee506-f5f4-4077-a0af-4d9d369e94ef req-5ca8303d-ff71-47e7-b2b4-727ae210d70a service nova] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 780.876353] env[69656]: INFO networking_nsxv3.common.synchronization [req-07cee506-f5f4-4077-a0af-4d9d369e94ef req-5ca8303d-ff71-47e7-b2b4-727ae210d70a service nova] Enqueued Resource ID: af5ece60-accf-4d00-894b-8c83236f8c97 with Priority: HIGHEST for action port [ 780.876353] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_rules [ 780.876353] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 780.876353] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5ece60-accf-4d00-894b-8c83236f8c97 with Priority: HIGHEST for action port [ 780.876353] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.877512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.877794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.878179] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.878391] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.879582] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.883227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.883379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.883701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.883885] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.884844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.884981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.885227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.886867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.887105] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.891092] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-af5ece60-accf-4d00-894b-8c83236f8c97 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.891248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.891315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.891488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.891571] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af5ece60-accf-4d00-894b-8c83236f8c97',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.188348] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.393743] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.394845] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.394958] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.395153] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af5ece60-accf-4d00-894b-8c83236f8c97 with status ACTIVE [ 781.395313] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.395417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.395478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.395685] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.395772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.395941] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.396052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.396112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.396264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.396340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.396548] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.396642] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.396702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.396848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.396912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.396995] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af5ece60-accf-4d00-894b-8c83236f8c97 is going to be updated. [ 781.417619] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.417809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.417853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.418083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.418228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.418400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.546476] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9050284-73b2-4fa6-becd-7f21223f038d in Status: SUCCESS [ 781.546699] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.546855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.547210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.547444] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.547574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.547647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.547810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.547893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.547979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.548083] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9050284-73b2-4fa6-becd-7f21223f038d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.692887] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.692887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.692887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.692887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.692887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.692887] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be updated. [ 781.695296] env[69656]: INFO networking_nsxv3.common.synchronization [req-743afded-fef8-416b-ad24-f846c2dc4c44 req-7a6bfef1-6dfe-434d-828c-1a9a3d6664dc tempest-ServersAdminTestJSON-1828746712 tempest-ServersAdminTestJSON-1828746712-project-member] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 781.696030] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 781.696030] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.696202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.696252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.696496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.696686] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.696816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.696899] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.697089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.697206] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.697341] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.718558] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.718707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.718766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.718969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.719170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.727677] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: IN_PROGRESS for 2s [ 781.899388] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.009401] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: SUCCESS [ 782.009676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.009857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.010693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.010836] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.053677] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9050284-73b2-4fa6-becd-7f21223f038d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.054061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.054191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.054548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.054839] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.055012] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.055132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.055416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.055589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.055734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.056044] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9050284-73b2-4fa6-becd-7f21223f038d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.056191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.056298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.056566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.056935] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.057193] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.057262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.057468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.057610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.058350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.058516] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9050284-73b2-4fa6-becd-7f21223f038d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.200956] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.201348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.201348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.201510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.201604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.201864] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.201994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.202080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.202280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.202362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.202473] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 already deleted. [ 782.202560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.215711] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.215969] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.216130] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.216519] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.216832] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.217073] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.217180] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.217447] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.217626] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.217869] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.218030] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.218152] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.218291] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.218411] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.218548] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.218692] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.242414] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.242591] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 782.242730] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.242914] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.243261] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-e550a22c-4445-4084-9cae-689cae3aa897 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.243431] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-e550a22c-4445-4084-9cae-689cae3aa897" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.243544] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-e550a22c-4445-4084-9cae-689cae3aa897" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.243895] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-e550a22c-4445-4084-9cae-689cae3aa897" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.244053] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e550a22c-4445-4084-9cae-689cae3aa897',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.409173] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.409173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.409173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.409410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.409535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.409642] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be created. [ 782.431044] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.431240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.431293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.431515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.431692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.447788] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: UNINITIALIZED for 2s [ 782.538269] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.538440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.538511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.538720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.538811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.538909] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be deleted. [ 782.548994] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 in Status: SUCCESS [ 782.549274] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 deletion is rescheduled due to dependency. [ 782.549441] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.560908] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9050284-73b2-4fa6-becd-7f21223f038d: rpc.has_security_group_logging(os_id): False [ 782.576611] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.576765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.576809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.577124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.577226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.577424] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.577543] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.577607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.577769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.577847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.578048] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.578148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.578209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.578347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.578422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.578630] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.578724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.578787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.578922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.578997] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.579185] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9050284-73b2-4fa6-becd-7f21223f038d is going to be created. [ 782.598051] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.598285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.598285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.598358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.598460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.598574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.633147] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.633291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.633359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.633600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.633784] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.644431] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9050284-73b2-4fa6-becd-7f21223f038d in Status: IN_PROGRESS for 2s [ 782.746645] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.746909] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.747101] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.747395] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.747564] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.747742] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port e550a22c-4445-4084-9cae-689cae3aa897 not found, creating... [ 782.748035] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.748191] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.748328] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.748549] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.748683] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.749067] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.749212] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.749335] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.749559] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.749707] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.749844] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: e550a22c-4445-4084-9cae-689cae3aa897 is going to be created. [ 782.772874] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.773134] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.773284] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.773584] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.773832] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.774091] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-e550a22c-4445-4084-9cae-689cae3aa897" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.630409] env[69656]: INFO networking_nsxv3.common.synchronization [req-743afded-fef8-416b-ad24-f846c2dc4c44 req-4e68abe2-ba3d-4878-a22e-8aabbb3dbba2 service nova] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_rules [ 783.630409] env[69656]: INFO networking_nsxv3.common.synchronization [req-743afded-fef8-416b-ad24-f846c2dc4c44 req-4e68abe2-ba3d-4878-a22e-8aabbb3dbba2 service nova] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 783.630409] env[69656]: INFO networking_nsxv3.common.synchronization [req-743afded-fef8-416b-ad24-f846c2dc4c44 req-4e68abe2-ba3d-4878-a22e-8aabbb3dbba2 service nova] Enqueued Resource ID: e550a22c-4445-4084-9cae-689cae3aa897 with Priority: HIGHEST for action port [ 783.630409] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_rules [ 783.630409] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 783.630409] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e550a22c-4445-4084-9cae-689cae3aa897 with Priority: HIGHEST for action port [ 783.630409] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.630927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.631142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.631579] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.631747] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.633537] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.633772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.633939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.634204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.634673] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.634902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.635145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.635834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.635834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.635834] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.638417] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e550a22c-4445-4084-9cae-689cae3aa897 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.638417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e550a22c-4445-4084-9cae-689cae3aa897" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.638417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e550a22c-4445-4084-9cae-689cae3aa897" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.638417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e550a22c-4445-4084-9cae-689cae3aa897" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.638417] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e550a22c-4445-4084-9cae-689cae3aa897',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.737414] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: SUCCESS [ 783.737602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.737808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.738120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.738383] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.738557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.738617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.738830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.738937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.739101] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.139312] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.139442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.139655] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.140905] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e550a22c-4445-4084-9cae-689cae3aa897 with status ACTIVE [ 784.141200] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.141312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.141371] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.141569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.141659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.141832] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.142023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.142023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.142163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.142283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.142431] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.142524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.142596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.142801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.142801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.143043] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e550a22c-4445-4084-9cae-689cae3aa897 is going to be updated. [ 784.163546] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.163677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.163786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.163978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.164132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.164321] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e550a22c-4445-4084-9cae-689cae3aa897" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.243808] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.243808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.243808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.243808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.243808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.243808] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.243808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.243808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.243808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.243808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.243808] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be deleted. [ 784.315387] env[69656]: INFO networking_nsxv3.common.synchronization [req-8f6bd82d-031c-42d0-9bfc-354ba2b77e37 req-99438a5a-b295-4512-a015-da7120ed806f tempest-ServersAdminTestJSON-1828746712 tempest-ServersAdminTestJSON-1828746712-project-member] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 784.315387] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 784.318015] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.318497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.327052] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.327052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.327052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.327052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.327052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.327052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.459577] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 784.459577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.459577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.459577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.459577] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.459577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.459577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.459577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.459577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.459577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.459577] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.644940] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.655974] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9050284-73b2-4fa6-becd-7f21223f038d in Status: SUCCESS [ 784.656258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.741935] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.742233] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.742559] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.742874] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.743176] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.743342] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.743480] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.743682] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.743821] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.744095] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.744236] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.744363] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.744494] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.744612] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.744736] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.744868] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.763970] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.763970] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 784.763970] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.763970] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.763970] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-13ff37f6-7fb3-4170-98db-ffd40dbf7e39 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.763970] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-13ff37f6-7fb3-4170-98db-ffd40dbf7e39" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.763970] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-13ff37f6-7fb3-4170-98db-ffd40dbf7e39" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.763970] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-13ff37f6-7fb3-4170-98db-ffd40dbf7e39" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.763970] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13ff37f6-7fb3-4170-98db-ffd40dbf7e39',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.964086] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.964086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.964086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.964086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.964086] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.964086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.964086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.964086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.964086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.964086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.964086] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.964086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.964086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.965101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.965520] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.965902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.967247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.967247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.967247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.967247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.967247] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.147955] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.148183] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.148183] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.148406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.148501] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.148606] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be created. [ 785.170585] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.170721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.170787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.171067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.171236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.179058] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: UNINITIALIZED for 2s [ 785.267715] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.267899] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.268010] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.268292] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.268443] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.268596] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 13ff37f6-7fb3-4170-98db-ffd40dbf7e39 not found, creating... [ 785.268917] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.269127] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.269251] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.269472] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.269606] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.269875] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.270035] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.270151] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.270350] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.270481] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.270611] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 13ff37f6-7fb3-4170-98db-ffd40dbf7e39 is going to be created. [ 785.290068] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.290068] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.290068] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.290068] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.290068] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.290365] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-13ff37f6-7fb3-4170-98db-ffd40dbf7e39" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.469680] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22763ac9-09b1-45ba-b8a9-6df4fc54e141: rpc.has_security_group_logging(os_id): False [ 785.487120] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.488041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.488041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.488041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.488041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.488041] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.488041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.488041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.488464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.488464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.488616] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.488672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.488711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.488918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.488918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.489121] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.489232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.489308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.489446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.489556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.489937] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be created. [ 785.549382] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.549540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.549638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.549823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.550014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.563468] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 786.104539] env[69656]: INFO networking_nsxv3.common.synchronization [req-8f6bd82d-031c-42d0-9bfc-354ba2b77e37 req-36f9a6b2-7f59-48f7-b9a8-8af3567f2841 service nova] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_rules [ 786.104804] env[69656]: INFO networking_nsxv3.common.synchronization [req-8f6bd82d-031c-42d0-9bfc-354ba2b77e37 req-36f9a6b2-7f59-48f7-b9a8-8af3567f2841 service nova] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 786.104948] env[69656]: INFO networking_nsxv3.common.synchronization [req-8f6bd82d-031c-42d0-9bfc-354ba2b77e37 req-36f9a6b2-7f59-48f7-b9a8-8af3567f2841 service nova] Enqueued Resource ID: 13ff37f6-7fb3-4170-98db-ffd40dbf7e39 with Priority: HIGHEST for action port [ 786.105524] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_rules [ 786.105524] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 786.105524] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13ff37f6-7fb3-4170-98db-ffd40dbf7e39 with Priority: HIGHEST for action port [ 786.108592] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.108710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.108927] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.109027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.109573] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-13ff37f6-7fb3-4170-98db-ffd40dbf7e39 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.109573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13ff37f6-7fb3-4170-98db-ffd40dbf7e39" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.109689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13ff37f6-7fb3-4170-98db-ffd40dbf7e39" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.109813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13ff37f6-7fb3-4170-98db-ffd40dbf7e39" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.109896] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13ff37f6-7fb3-4170-98db-ffd40dbf7e39',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.617729] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13ff37f6-7fb3-4170-98db-ffd40dbf7e39 with status ACTIVE [ 786.617729] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.617729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.617729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.617729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.617729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.617729] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.617729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.617729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.618283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.618283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.618283] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.618283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.618514] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.618688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.618688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.618843] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13ff37f6-7fb3-4170-98db-ffd40dbf7e39 is going to be updated. [ 786.642014] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.642014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.642014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.642351] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.642539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.642608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13ff37f6-7fb3-4170-98db-ffd40dbf7e39" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.188619] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 787.188898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.189050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.189305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.189509] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.189624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.189690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.189859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.189937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.190036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.190167] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.193181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.193254] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.193423] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.193530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.193595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.193785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.193824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.193917] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.575561] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 787.575798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.701020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.701020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.701020] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.201948] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.709593] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.709593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.709593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.709593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.709593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.709593] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be updated. [ 788.734578] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.735350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.735644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.736117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.736546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.813956] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 788.932159] env[69656]: INFO networking_nsxv3.common.synchronization [req-4b3bb6a2-3f6f-46ab-92f3-6d151076f7f3 req-9e885d18-81ca-4b6a-bc77-61b10878025d tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_members [ 788.933441] env[69656]: INFO networking_nsxv3.common.synchronization [req-4b3bb6a2-3f6f-46ab-92f3-6d151076f7f3 req-9e885d18-81ca-4b6a-bc77-61b10878025d tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 788.933441] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_members [ 788.933441] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 788.939442] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-037b783b-a9e4-4669-8461-2452a42615e1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.939442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.939442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.939442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.939442] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.939442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.939442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.939442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.939442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.939442] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.939442] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.939442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.939442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.939442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.939442] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.939442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.939442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.939442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.940125] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.940125] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.022482] env[69656]: INFO networking_nsxv3.common.synchronization [req-4b3bb6a2-3f6f-46ab-92f3-6d151076f7f3 req-9e885d18-81ca-4b6a-bc77-61b10878025d tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_rules [ 789.024127] env[69656]: INFO networking_nsxv3.common.synchronization [req-4b3bb6a2-3f6f-46ab-92f3-6d151076f7f3 req-9e885d18-81ca-4b6a-bc77-61b10878025d tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_members [ 789.024127] env[69656]: INFO networking_nsxv3.common.synchronization [req-4b3bb6a2-3f6f-46ab-92f3-6d151076f7f3 req-9e885d18-81ca-4b6a-bc77-61b10878025d tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_rules [ 789.024127] env[69656]: INFO networking_nsxv3.common.synchronization [req-4b3bb6a2-3f6f-46ab-92f3-6d151076f7f3 req-9e885d18-81ca-4b6a-bc77-61b10878025d tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 789.024127] env[69656]: INFO networking_nsxv3.common.synchronization [req-4b3bb6a2-3f6f-46ab-92f3-6d151076f7f3 req-9e885d18-81ca-4b6a-bc77-61b10878025d tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: af5ece60-accf-4d00-894b-8c83236f8c97 with Priority: HIGHEST for action port [ 789.028239] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_rules [ 789.028239] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_rules [ 789.028239] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5ece60-accf-4d00-894b-8c83236f8c97 with Priority: HIGHEST for action port [ 789.028239] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_members [ 789.028239] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 789.028239] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-037b783b-a9e4-4669-8461-2452a42615e1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.028239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.028239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.028239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.028239] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.028239] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.028239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.029594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.030449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.030449] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.031838] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-af5ece60-accf-4d00-894b-8c83236f8c97 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.032379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.033821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.033821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.033821] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af5ece60-accf-4d00-894b-8c83236f8c97',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.034748] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-037b783b-a9e4-4669-8461-2452a42615e1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.034855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.035083] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.035200] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.336173] env[69656]: INFO networking_nsxv3.common.synchronization [req-7bdd3769-09cf-400b-9591-88ea91d27436 req-e4bb9774-bbb3-43aa-af1d-21e3b638d89b tempest-ServerAddressesNegativeTestJSON-1086921251 tempest-ServerAddressesNegativeTestJSON-1086921251-project-member] Enqueued Resource ID: 7231807f-8442-4d3b-854a-2fa3a40877dd with Priority: HIGHEST for action security_group_members [ 789.336425] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7231807f-8442-4d3b-854a-2fa3a40877dd with Priority: HIGHEST for action security_group_members [ 789.336712] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7231807f-8442-4d3b-854a-2fa3a40877dd taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.336837] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.336904] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.337786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.337786] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.337786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.337786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.337786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.338532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.338642] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7231807f-8442-4d3b-854a-2fa3a40877dd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.443862] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.446292] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.537071] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-037b783b-a9e4-4669-8461-2452a42615e1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.537071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.538675] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af5ece60-accf-4d00-894b-8c83236f8c97 with status ACTIVE [ 789.538799] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.538921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.538988] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.539261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.539359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.539537] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.539638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.539701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.539853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.539930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.540144] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.540261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.540324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.540467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.540544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.540630] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af5ece60-accf-4d00-894b-8c83236f8c97 is going to be updated. [ 789.541759] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.541849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.568259] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.568398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.568779] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.569055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.569399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.569600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.654134] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-497 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.654134] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-497" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.654134] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-497" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.654134] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-497" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.654134] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.654134] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.655354] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.655756] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.656074] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.656432] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.656704] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.656988] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.657265] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.657533] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.658322] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.658322] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.678738] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.678738] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 789.678738] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.678738] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-497" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.678738] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-a32f4d91-d2a6-43ea-9663-247ca16cfaed taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.678738] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-a32f4d91-d2a6-43ea-9663-247ca16cfaed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.678738] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-a32f4d91-d2a6-43ea-9663-247ca16cfaed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.678738] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-a32f4d91-d2a6-43ea-9663-247ca16cfaed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.678738] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a32f4d91-d2a6-43ea-9663-247ca16cfaed',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.712046] env[69656]: INFO networking_nsxv3.common.synchronization [req-a699e6d8-4ccc-4471-b935-929f2d990df9 req-864eca6a-2f14-48bc-b5b4-787226e81221 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 753a0574-7bcf-4133-85db-b811b57f750a with Priority: HIGHEST for action security_group_members [ 789.712046] env[69656]: INFO networking_nsxv3.common.synchronization [req-a699e6d8-4ccc-4471-b935-929f2d990df9 req-864eca6a-2f14-48bc-b5b4-787226e81221 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_members [ 789.712046] env[69656]: INFO networking_nsxv3.common.synchronization [req-a699e6d8-4ccc-4471-b935-929f2d990df9 req-864eca6a-2f14-48bc-b5b4-787226e81221 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 789.715601] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 753a0574-7bcf-4133-85db-b811b57f750a with Priority: HIGHEST for action security_group_members [ 789.715601] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_members [ 789.715601] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 789.715601] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-753a0574-7bcf-4133-85db-b811b57f750a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.715601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.715601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.715601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.715601] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.715601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.715601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.715601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.715601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.715601] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.716910] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-037b783b-a9e4-4669-8461-2452a42615e1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.717149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.718124] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.718358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.816094] env[69656]: INFO networking_nsxv3.common.synchronization [req-a699e6d8-4ccc-4471-b935-929f2d990df9 req-864eca6a-2f14-48bc-b5b4-787226e81221 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_rules [ 789.817976] env[69656]: INFO networking_nsxv3.common.synchronization [req-a699e6d8-4ccc-4471-b935-929f2d990df9 req-864eca6a-2f14-48bc-b5b4-787226e81221 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_members [ 789.817976] env[69656]: INFO networking_nsxv3.common.synchronization [req-a699e6d8-4ccc-4471-b935-929f2d990df9 req-864eca6a-2f14-48bc-b5b4-787226e81221 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_rules [ 789.817976] env[69656]: INFO networking_nsxv3.common.synchronization [req-a699e6d8-4ccc-4471-b935-929f2d990df9 req-864eca6a-2f14-48bc-b5b4-787226e81221 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 789.822121] env[69656]: INFO networking_nsxv3.common.synchronization [req-a699e6d8-4ccc-4471-b935-929f2d990df9 req-864eca6a-2f14-48bc-b5b4-787226e81221 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 753a0574-7bcf-4133-85db-b811b57f750a with Priority: HIGHEST for action security_group_rules [ 789.822121] env[69656]: INFO networking_nsxv3.common.synchronization [req-a699e6d8-4ccc-4471-b935-929f2d990df9 req-864eca6a-2f14-48bc-b5b4-787226e81221 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 753a0574-7bcf-4133-85db-b811b57f750a with Priority: HIGHEST for action security_group_members [ 789.822121] env[69656]: INFO networking_nsxv3.common.synchronization [req-a699e6d8-4ccc-4471-b935-929f2d990df9 req-864eca6a-2f14-48bc-b5b4-787226e81221 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: af5ece60-accf-4d00-894b-8c83236f8c97 with Priority: HIGHEST for action port [ 789.822121] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_rules [ 789.822121] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_rules [ 789.822286] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 753a0574-7bcf-4133-85db-b811b57f750a with Priority: HIGHEST for action security_group_members [ 789.823113] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5ece60-accf-4d00-894b-8c83236f8c97 with Priority: HIGHEST for action port [ 789.823113] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 753a0574-7bcf-4133-85db-b811b57f750a with Priority: HIGHEST for action security_group_rules [ 789.823113] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_members [ 789.823113] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 789.823113] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-037b783b-a9e4-4669-8461-2452a42615e1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.823341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.823434] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.824261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.824261] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-753a0574-7bcf-4133-85db-b811b57f750a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.824261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.824261] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-af5ece60-accf-4d00-894b-8c83236f8c97 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.824261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.824261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.824615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.824692] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af5ece60-accf-4d00-894b-8c83236f8c97',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.825675] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-753a0574-7bcf-4133-85db-b811b57f750a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.825827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.825940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.826271] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.826392] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.827214] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-037b783b-a9e4-4669-8461-2452a42615e1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.827347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.829125] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.829821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.840690] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.840856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.840927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.841195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.841299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.841539] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.841618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.841678] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.841853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.841933] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.842057] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7231807f-8442-4d3b-854a-2fa3a40877dd already deleted. [ 789.842141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.947428] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.953336] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.182600] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.184027] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.184027] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.184027] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.184657] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.191461] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port a32f4d91-d2a6-43ea-9663-247ca16cfaed not found, creating... [ 790.191461] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.191461] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.191461] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.191461] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.191461] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.191461] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.191461] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.191461] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.193241] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.193845] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.194432] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: a32f4d91-d2a6-43ea-9663-247ca16cfaed is going to be created. [ 790.222758] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.222758] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.222758] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.222758] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.222758] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.222758] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.223603] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-a32f4d91-d2a6-43ea-9663-247ca16cfaed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.331263] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af5ece60-accf-4d00-894b-8c83236f8c97 with status ACTIVE [ 790.331612] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.331810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.331939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.332208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.334164] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.334535] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.334719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.334827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.335205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.335205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.335489] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.335663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.335784] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.336012] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.336153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.336286] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af5ece60-accf-4d00-894b-8c83236f8c97 is going to be updated. [ 790.337696] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-753a0574-7bcf-4133-85db-b811b57f750a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.339273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.369890] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.370106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.370950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.370950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.370950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.370950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af5ece60-accf-4d00-894b-8c83236f8c97" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.453022] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.453022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.453022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.453022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.453022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.453022] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037b783b-a9e4-4669-8461-2452a42615e1 is going to be created. [ 790.456311] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.456620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.456731] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.457057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.457258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.457463] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 790.486458] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.486935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.487151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.487474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.487748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.495582] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.495804] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.495908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.496166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.496937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.499350] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: UNINITIALIZED for 2s [ 790.511817] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 790.551729] env[69656]: INFO networking_nsxv3.common.synchronization [req-bc4e9742-e104-40fe-9eb1-37a567c533e0 req-aac30adf-2ca2-446f-a37d-cd2416f88df4 tempest-TenantUsagesTestJSON-872215049 tempest-TenantUsagesTestJSON-872215049-project-member] Enqueued Resource ID: c9050284-73b2-4fa6-becd-7f21223f038d with Priority: HIGHEST for action security_group_members [ 790.551729] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9050284-73b2-4fa6-becd-7f21223f038d with Priority: HIGHEST for action security_group_members [ 790.551729] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9050284-73b2-4fa6-becd-7f21223f038d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.551729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.551729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.551729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.551923] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.551923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.552059] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.552167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.552315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.552482] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9050284-73b2-4fa6-becd-7f21223f038d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.728221] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.824035] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 790.824035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.824326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.824742] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.826622] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.826622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.826622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.826622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.826622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.826622] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.897427] env[69656]: INFO networking_nsxv3.common.synchronization [req-7bdd3769-09cf-400b-9591-88ea91d27436 req-ae714290-e4db-44be-bbb5-20d8bd53330f service nova] Enqueued Resource ID: 7231807f-8442-4d3b-854a-2fa3a40877dd with Priority: HIGHEST for action security_group_rules [ 790.897427] env[69656]: INFO networking_nsxv3.common.synchronization [req-7bdd3769-09cf-400b-9591-88ea91d27436 req-ae714290-e4db-44be-bbb5-20d8bd53330f service nova] Enqueued Resource ID: 7231807f-8442-4d3b-854a-2fa3a40877dd with Priority: HIGHEST for action security_group_members [ 790.897427] env[69656]: INFO networking_nsxv3.common.synchronization [req-7bdd3769-09cf-400b-9591-88ea91d27436 req-ae714290-e4db-44be-bbb5-20d8bd53330f service nova] Enqueued Resource ID: a32f4d91-d2a6-43ea-9663-247ca16cfaed with Priority: HIGHEST for action port [ 790.897427] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7231807f-8442-4d3b-854a-2fa3a40877dd with Priority: HIGHEST for action security_group_rules [ 790.897427] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7231807f-8442-4d3b-854a-2fa3a40877dd with Priority: HIGHEST for action security_group_members [ 790.897427] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a32f4d91-d2a6-43ea-9663-247ca16cfaed with Priority: HIGHEST for action port [ 790.897427] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7231807f-8442-4d3b-854a-2fa3a40877dd taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.897427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.897427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.897427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.897427] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7231807f-8442-4d3b-854a-2fa3a40877dd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.899468] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7231807f-8442-4d3b-854a-2fa3a40877dd taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.900040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.900206] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.900559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.900808] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.901059] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.901207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.901526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.901706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.901877] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7231807f-8442-4d3b-854a-2fa3a40877dd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.903028] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-a32f4d91-d2a6-43ea-9663-247ca16cfaed taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.903279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a32f4d91-d2a6-43ea-9663-247ca16cfaed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.903435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a32f4d91-d2a6-43ea-9663-247ca16cfaed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.903759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a32f4d91-d2a6-43ea-9663-247ca16cfaed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.905116] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a32f4d91-d2a6-43ea-9663-247ca16cfaed',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.057870] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.058034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.058108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.058326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.058451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.058649] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.058750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.058810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.059046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.059223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.059360] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9050284-73b2-4fa6-becd-7f21223f038d is going to be updated. [ 791.087287] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.087482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.087558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.087843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.088024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.096272] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9050284-73b2-4fa6-becd-7f21223f038d in Status: IN_PROGRESS for 2s [ 791.230313] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.230718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.230718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.230938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.230938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.230938] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 753a0574-7bcf-4133-85db-b811b57f750a is going to be created. [ 791.255893] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.256093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.256153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.256345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.256507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.265252] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 753a0574-7bcf-4133-85db-b811b57f750a in Status: UNINITIALIZED for 2s [ 791.332904] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.400518] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7231807f-8442-4d3b-854a-2fa3a40877dd taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.400885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.408357] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7231807f-8442-4d3b-854a-2fa3a40877dd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.409437] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a32f4d91-d2a6-43ea-9663-247ca16cfaed with status ACTIVE [ 791.409636] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.409773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.409812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.410483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.410483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.410483] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.410483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.410483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.410805] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.410805] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.410869] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.410916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.410948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.411821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.411821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.411821] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a32f4d91-d2a6-43ea-9663-247ca16cfaed is going to be updated. [ 791.438349] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.438794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.438958] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.439167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.439637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.439637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a32f4d91-d2a6-43ea-9663-247ca16cfaed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.839020] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.915193] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7231807f-8442-4d3b-854a-2fa3a40877dd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.339105] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.339105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.339105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.339105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.339105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.339566] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be updated. [ 792.364891] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.365020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.365099] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.365559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.365559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.373113] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 792.417735] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.418043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.418043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.418373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.418373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.418439] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7231807f-8442-4d3b-854a-2fa3a40877dd is going to be created. [ 792.448931] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.449176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.449262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.449464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.449637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.477803] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7231807f-8442-4d3b-854a-2fa3a40877dd in Status: UNINITIALIZED for 2s [ 792.514429] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: SUCCESS [ 792.514690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.514863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.515058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.515243] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.515391] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.515443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.515569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.515646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.516412] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.525552] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 792.525715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.525891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.526116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.526319] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.526431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.526489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.526665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.526798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.526852] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.020817] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.029142] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.104815] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9050284-73b2-4fa6-becd-7f21223f038d in Status: IN_PROGRESS for 4s [ 793.275080] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 753a0574-7bcf-4133-85db-b811b57f750a in Status: SUCCESS [ 793.275567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.275567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.276506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.276506] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.276506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.276506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.276506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.276814] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.276814] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.525410] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.530997] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.781387] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.030105] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.034340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.034340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.034340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.034340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.034340] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037b783b-a9e4-4669-8461-2452a42615e1 is going to be updated. [ 794.034340] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.034340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.034340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.034340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.034340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.034340] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 794.061878] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.062272] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.062450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.062741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.063267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.065230] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.065885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.066067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.066355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.066607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.077627] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 794.079343] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: IN_PROGRESS for 2s [ 794.287035] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.382380] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 794.382616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.382787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.382999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.383200] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.383317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.383382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.383534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.383615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.383699] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.383848] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.383939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.384006] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.384154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.384294] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.384382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.384442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.384571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.384674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.384708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.384798] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.487123] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7231807f-8442-4d3b-854a-2fa3a40877dd in Status: SUCCESS [ 794.487123] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.487272] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.487443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.487644] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.487743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.487807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.487959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.488053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.488137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.488224] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7231807f-8442-4d3b-854a-2fa3a40877dd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.792426] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.792752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.792752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.792962] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.792962] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.793056] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 753a0574-7bcf-4133-85db-b811b57f750a is going to be updated. [ 794.818977] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.819224] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.819323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.819512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.819660] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.828416] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 753a0574-7bcf-4133-85db-b811b57f750a in Status: IN_PROGRESS for 2s [ 794.888529] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d9740de-f67c-4fbd-a249-44afc4caaef1: rpc.has_security_group_logging(os_id): False [ 794.905329] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.905497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.905610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.905828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.905919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.906145] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.906474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.906474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.906474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.906633] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.906697] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.906788] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.906849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.906985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.907080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.907297] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.907432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.907468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.907614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.907689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.907775] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be created. [ 794.964720] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.965239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.965454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.965770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.966226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.977606] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 794.991372] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7231807f-8442-4d3b-854a-2fa3a40877dd taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.991544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.991626] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.994033] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.994033] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7231807f-8442-4d3b-854a-2fa3a40877dd taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.994033] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.994033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.994033] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7231807f-8442-4d3b-854a-2fa3a40877dd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.116605] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9050284-73b2-4fa6-becd-7f21223f038d in Status: SUCCESS [ 795.116935] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9050284-73b2-4fa6-becd-7f21223f038d deletion is rescheduled due to dependency. [ 795.117023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.498808] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7231807f-8442-4d3b-854a-2fa3a40877dd: rpc.has_security_group_logging(os_id): False [ 795.519423] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.519896] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.520556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.520889] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.521113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.521722] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.522063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.522379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.523521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.526036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.526036] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.526036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.526036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.526036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.526036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.526036] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.526036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.526036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.526036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.526036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.526036] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7231807f-8442-4d3b-854a-2fa3a40877dd is going to be created. [ 795.578828] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.579062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.579216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.579494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.579772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.589236] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7231807f-8442-4d3b-854a-2fa3a40877dd in Status: IN_PROGRESS for 2s [ 795.899552] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 795.899862] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=15 [ 796.088743] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 796.088743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.089069] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: SUCCESS [ 796.089277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.089437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.089636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.089826] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.089934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.089991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.090265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.090265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.090410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.090410] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.091445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.091445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.095369] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.095369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.095369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.095369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.095369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.095584] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.095584] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.096553] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.096919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.096919] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.096919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.097324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.097324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.097324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.097474] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.098021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.098879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.098879] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.098879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.098879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.098879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.098879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.098879] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.597947] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.597947] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.602115] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.602115] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.602115] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.702070] env[69656]: INFO networking_nsxv3.common.synchronization [None req-7e386400-6e25-44cf-a7a5-5cf1cfcfd253 None None] Enqueued Resource ID: 0e4c52c0-6226-4a99-8f31-726c3ace3b28 with Priority: HIGHEST for action port [ 796.702632] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e4c52c0-6226-4a99-8f31-726c3ace3b28 with Priority: HIGHEST for action port [ 796.702893] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e4c52c0-6226-4a99-8f31-726c3ace3b28 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.703058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e4c52c0-6226-4a99-8f31-726c3ace3b28" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.703118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e4c52c0-6226-4a99-8f31-726c3ace3b28" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.703392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e4c52c0-6226-4a99-8f31-726c3ace3b28" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.703474] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e4c52c0-6226-4a99-8f31-726c3ace3b28',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.799883] env[69656]: INFO networking_nsxv3.common.synchronization [req-1b176a0b-dae3-49ad-95ec-2bf3f50c2a68 req-57ef375f-fcff-4a5b-b55f-87dce5894bda tempest-ListImageFiltersTestJSON-1291126279 tempest-ListImageFiltersTestJSON-1291126279-project-member] Enqueued Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_members [ 796.800498] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_members [ 796.800710] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.800830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.800897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.801592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.801771] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.801877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.801941] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.802122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.802208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.802616] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.838288] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 753a0574-7bcf-4133-85db-b811b57f750a in Status: SUCCESS [ 796.838501] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.838654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.838858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.839056] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.839173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.839257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.839425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.839613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.839613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.839613] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.989103] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 796.989503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.989599] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.989813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.989933] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.104618] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.106214] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 037b783b-a9e4-4669-8461-2452a42615e1: rpc.has_security_group_logging(os_id): False [ 797.106771] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.126431] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.126830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.127063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.129046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.129046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.129046] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.129046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.129046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.129046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.129046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.129046] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 037b783b-a9e4-4669-8461-2452a42615e1 is going to be created. [ 797.189835] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.190066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.190135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.190377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.190582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.206216] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: IN_PROGRESS for 2s [ 797.206216] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e4c52c0-6226-4a99-8f31-726c3ace3b28 [ 797.206216] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.206416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.206416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.206494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.206584] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.206674] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e4c52c0-6226-4a99-8f31-726c3ace3b28 already deleted. [ 797.206847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e4c52c0-6226-4a99-8f31-726c3ace3b28" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.304311] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.342737] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.492500] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.492740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.492740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.492948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.494066] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.494198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.494350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.494445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.494533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.494640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.494788] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.609426] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7231807f-8442-4d3b-854a-2fa3a40877dd in Status: SUCCESS [ 797.610035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.610323] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.610487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.610487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.610729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.610868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.611049] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037b783b-a9e4-4669-8461-2452a42615e1 is going to be updated. [ 797.612392] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.612533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.612593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.612799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.612901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.612985] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 797.651783] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.651931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.651987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.652218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.652358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.654087] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.654205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.654271] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.654433] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.654548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.664044] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 797.664787] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: IN_PROGRESS for 2s [ 797.806889] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.845695] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 753a0574-7bcf-4133-85db-b811b57f750a: rpc.has_security_group_logging(os_id): False [ 797.864114] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.864336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.864336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.865833] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.866008] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.866269] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.866378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.866443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.867135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.867135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.867135] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 753a0574-7bcf-4133-85db-b811b57f750a is going to be created. [ 797.925125] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.925346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.925429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.925643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.925856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.935896] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 753a0574-7bcf-4133-85db-b811b57f750a in Status: IN_PROGRESS for 2s [ 797.998231] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.998748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.998748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.998883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.999146] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.003025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.003025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.003025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.003025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.003025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.003025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.003025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.003025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.003025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.003025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.003025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.003025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.003025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.003025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.003025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.003025] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.310220] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.310366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.310436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.310646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.310732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.310836] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 is going to be updated. [ 798.336931] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.337363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.337363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.337622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.337622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.345546] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: IN_PROGRESS for 2s [ 798.506954] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d9740de-f67c-4fbd-a249-44afc4caaef1: rpc.has_security_group_logging(os_id): False [ 798.525920] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.526119] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.526196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.526412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.526522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.526742] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.526844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.526962] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.530471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.530592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.530854] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.530962] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.531370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.531626] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.531730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.531951] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.532072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.532184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.532286] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.532362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.532447] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be updated. [ 798.588064] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.590027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.590120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.590349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.590511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.603765] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 798.879787] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d14c981b-bee1-43b3-ae41-a759dd0b3f5a None None] Enqueued Resource ID: 213a33a7-e403-4dc2-8712-7885afc6bb5f with Priority: HIGHEST for action port [ 798.880068] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 213a33a7-e403-4dc2-8712-7885afc6bb5f with Priority: HIGHEST for action port [ 798.880674] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-213a33a7-e403-4dc2-8712-7885afc6bb5f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.880816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-213a33a7-e403-4dc2-8712-7885afc6bb5f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.880883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-213a33a7-e403-4dc2-8712-7885afc6bb5f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.881268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-213a33a7-e403-4dc2-8712-7885afc6bb5f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.881356] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('213a33a7-e403-4dc2-8712-7885afc6bb5f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.994269] env[69656]: INFO networking_nsxv3.common.synchronization [req-df336cfa-96d6-49ff-9c58-0c6f45f4c565 req-91dd517a-5c1a-4f24-b309-cdb96df1bcc7 tempest-FloatingIPsAssociationTestJSON-1340927557 tempest-FloatingIPsAssociationTestJSON-1340927557-project-member] Enqueued Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_members [ 798.994837] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGHEST for action security_group_members [ 798.995164] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.995284] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.995347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.995539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.995680] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.995771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.995830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.995969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.996069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.996158] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.218477] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: SUCCESS [ 799.218923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.218995] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.219182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.219295] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.384086] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 213a33a7-e403-4dc2-8712-7885afc6bb5f [ 799.384339] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.384479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.384544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.384767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.384904] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.384956] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:213a33a7-e403-4dc2-8712-7885afc6bb5f already deleted. [ 799.385050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-213a33a7-e403-4dc2-8712-7885afc6bb5f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.499529] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.499721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.499798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.499965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.500071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.500268] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.500371] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.500416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.501451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.501451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.501451] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97579684-a77f-4bf3-9586-742120a2eca4 is going to be updated. [ 799.529304] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.529304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.529304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.529304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.529304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.538358] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: IN_PROGRESS for 2s [ 799.674667] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: SUCCESS [ 799.674919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.675071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.675293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.675499] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.675592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.675657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.675821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.675883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.676364] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.677462] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 799.677627] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.677750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.677908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.678071] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.678174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.678315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.678380] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.678448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.678592] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.724357] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-037b783b-a9e4-4669-8461-2452a42615e1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.724357] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.947264] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 753a0574-7bcf-4133-85db-b811b57f750a in Status: SUCCESS [ 799.947507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.182585] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.184053] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.312807] env[69656]: INFO networking_nsxv3.common.synchronization [None req-26809c8e-9bc3-4a34-98f1-24e6f1d9ea3f tempest-ImagesOneServerNegativeTestJSON-384940824 tempest-ImagesOneServerNegativeTestJSON-384940824-project-member] Enqueued Resource ID: 9f74c999-6233-4786-a4f0-9bcad9e1008f with Priority: HIGHEST for action security_group_rules [ 800.313404] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f74c999-6233-4786-a4f0-9bcad9e1008f with Priority: HIGHEST for action security_group_rules [ 800.313709] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f74c999-6233-4786-a4f0-9bcad9e1008f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.313832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f74c999-6233-4786-a4f0-9bcad9e1008f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.313888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f74c999-6233-4786-a4f0-9bcad9e1008f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.314142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f74c999-6233-4786-a4f0-9bcad9e1008f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.314217] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f74c999-6233-4786-a4f0-9bcad9e1008f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.355993] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: SUCCESS [ 800.356249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.393927] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f5bd782a-809f-42a8-b839-034d9d04872b tempest-ImagesOneServerNegativeTestJSON-384940824 tempest-ImagesOneServerNegativeTestJSON-384940824-project-member] Enqueued Resource ID: 9f74c999-6233-4786-a4f0-9bcad9e1008f with Priority: HIGHEST for action security_group_rules [ 800.394532] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f74c999-6233-4786-a4f0-9bcad9e1008f with Priority: HIGHEST for action security_group_rules [ 800.394826] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f74c999-6233-4786-a4f0-9bcad9e1008f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.394934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f74c999-6233-4786-a4f0-9bcad9e1008f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.617130] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 800.617391] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.687902] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.687902] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.834350] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.834562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.834562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.834683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.834772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.834867] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f74c999-6233-4786-a4f0-9bcad9e1008f already deleted. [ 800.834945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f74c999-6233-4786-a4f0-9bcad9e1008f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.835164] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f74c999-6233-4786-a4f0-9bcad9e1008f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.835244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f74c999-6233-4786-a4f0-9bcad9e1008f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.835480] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f74c999-6233-4786-a4f0-9bcad9e1008f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.191303] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.192027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.192027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.192027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.192027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.192027] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037b783b-a9e4-4669-8461-2452a42615e1 is going to be updated. [ 801.193219] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.193350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.193388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.193557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.194585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.194585] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 801.231067] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.231224] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.231322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.231518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.231702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.233391] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.233520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.233591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.234113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.234113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.243824] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: IN_PROGRESS for 2s [ 801.244741] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 801.356656] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.356980] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.356980] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.357096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.357288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.357394] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f74c999-6233-4786-a4f0-9bcad9e1008f already deleted. [ 801.357481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f74c999-6233-4786-a4f0-9bcad9e1008f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.459681] env[69656]: INFO networking_nsxv3.common.synchronization [req-1f00c9b6-b5e5-4f3b-8638-a911a8bd7e71 req-61cdc746-4198-4d48-bbf6-e9190839790c tempest-ServerAddressesNegativeTestJSON-1086921251 tempest-ServerAddressesNegativeTestJSON-1086921251-project-member] Enqueued Resource ID: 7231807f-8442-4d3b-854a-2fa3a40877dd with Priority: HIGHEST for action security_group_members [ 801.460284] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7231807f-8442-4d3b-854a-2fa3a40877dd with Priority: HIGHEST for action security_group_members [ 801.460625] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7231807f-8442-4d3b-854a-2fa3a40877dd taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.460761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.460840] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.461785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.461785] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.461785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.461785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.461785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.461785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.461785] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7231807f-8442-4d3b-854a-2fa3a40877dd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.547288] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97579684-a77f-4bf3-9586-742120a2eca4 in Status: SUCCESS [ 801.547474] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97579684-a77f-4bf3-9586-742120a2eca4 deletion is rescheduled due to dependency. [ 801.547586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.963610] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.963777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.963849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.964098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.964194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.964387] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.964490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.964551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.964705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.964782] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.964865] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7231807f-8442-4d3b-854a-2fa3a40877dd is going to be updated. [ 801.992975] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.993149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.993221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.993409] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.993551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.000992] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7231807f-8442-4d3b-854a-2fa3a40877dd in Status: IN_PROGRESS for 2s [ 802.899637] env[69656]: INFO networking_nsxv3.common.synchronization [req-111a1e22-ea53-4683-b29e-ac1deb14914e req-046ba670-5e32-4df1-9ffb-d0048178843f tempest-InstanceActionsV221TestJSON-860969385 tempest-InstanceActionsV221TestJSON-860969385-project-member] Enqueued Resource ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 with Priority: HIGHEST for action security_group_members [ 802.900279] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 with Priority: HIGHEST for action security_group_members [ 802.900607] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cc9edd3-ec13-4776-b83d-312440c75c07 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.900738] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.900804] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.901092] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.901253] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.901355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.901437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.901597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.901683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.901777] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cc9edd3-ec13-4776-b83d-312440c75c07',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.242901] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.243871] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-484" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.243871] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-484" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.244663] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-484" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.244663] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.244663] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.244663] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.245746] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.245746] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.245746] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.245899] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 803.245990] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 803.246129] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 803.246843] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.247041] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 803.247230] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.260141] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 803.260306] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.260472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.260657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.260837] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.261024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.261092] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.261248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.261346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.261410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.261799] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.261937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.262009] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.262172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.262316] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.262407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.262462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.262606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.262688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.262771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.262858] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.264330] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: SUCCESS [ 803.264539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.264935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.265178] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.266142] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.266142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.266142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.266142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.266381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.266381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.266381] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.268961] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.268961] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 803.269437] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.269437] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-484" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.269968] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-29726e4c-6af7-42a8-9a4a-cd9a73ac77b0 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.269968] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-29726e4c-6af7-42a8-9a4a-cd9a73ac77b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.269968] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-29726e4c-6af7-42a8-9a4a-cd9a73ac77b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.270164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-29726e4c-6af7-42a8-9a4a-cd9a73ac77b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.270367] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29726e4c-6af7-42a8-9a4a-cd9a73ac77b0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.404864] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.405435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.405435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.405435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.405435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.405729] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.405729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.405729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.405925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.405967] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.406042] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 already deleted. [ 803.406124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.767526] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22763ac9-09b1-45ba-b8a9-6df4fc54e141: rpc.has_security_group_logging(os_id): False [ 803.768643] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.773047] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.773047] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.773047] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.773047] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.773944] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.773944] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 29726e4c-6af7-42a8-9a4a-cd9a73ac77b0 not found, creating... [ 803.773944] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.773944] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.773944] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.774154] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.774154] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.774412] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.774566] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.774683] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.774893] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.775277] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.775473] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 29726e4c-6af7-42a8-9a4a-cd9a73ac77b0 is going to be created. [ 803.790750] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.790874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.790954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.791129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.791211] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.791389] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.791484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.791549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.791693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.791767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.791956] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.792060] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.792127] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.792253] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.792418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.792617] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.792712] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.792767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.792907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.792983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.793077] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 803.795039] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.795220] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.795343] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.795552] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.795764] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.795972] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-29726e4c-6af7-42a8-9a4a-cd9a73ac77b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.860564] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.860757] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.860757] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.860917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.861078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.873544] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 804.011924] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7231807f-8442-4d3b-854a-2fa3a40877dd in Status: SUCCESS [ 804.012243] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7231807f-8442-4d3b-854a-2fa3a40877dd deletion is rescheduled due to dependency. [ 804.012243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.271305] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 037b783b-a9e4-4669-8461-2452a42615e1: rpc.has_security_group_logging(os_id): False [ 804.287815] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.287965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.288039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.288231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.288325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.288547] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.288648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.288708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.288854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.288930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.289022] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 037b783b-a9e4-4669-8461-2452a42615e1 is going to be updated. [ 804.341115] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.341427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.341556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.341850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.342086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.354605] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: IN_PROGRESS for 2s [ 804.562438] env[69656]: INFO networking_nsxv3.common.synchronization [req-111a1e22-ea53-4683-b29e-ac1deb14914e req-210f0a34-df89-4bb2-9986-4003c5bf5d95 service nova] Enqueued Resource ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 with Priority: HIGHEST for action security_group_rules [ 804.562438] env[69656]: INFO networking_nsxv3.common.synchronization [req-111a1e22-ea53-4683-b29e-ac1deb14914e req-210f0a34-df89-4bb2-9986-4003c5bf5d95 service nova] Enqueued Resource ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 with Priority: HIGHEST for action security_group_members [ 804.562682] env[69656]: INFO networking_nsxv3.common.synchronization [req-111a1e22-ea53-4683-b29e-ac1deb14914e req-210f0a34-df89-4bb2-9986-4003c5bf5d95 service nova] Enqueued Resource ID: 29726e4c-6af7-42a8-9a4a-cd9a73ac77b0 with Priority: HIGHEST for action port [ 804.562766] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 with Priority: HIGHEST for action security_group_rules [ 804.562892] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 with Priority: HIGHEST for action security_group_members [ 804.562984] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29726e4c-6af7-42a8-9a4a-cd9a73ac77b0 with Priority: HIGHEST for action port [ 804.563530] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cc9edd3-ec13-4776-b83d-312440c75c07 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.563650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.563715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.565082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.565082] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cc9edd3-ec13-4776-b83d-312440c75c07',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.565366] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cc9edd3-ec13-4776-b83d-312440c75c07 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.565483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.565547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.567331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.567331] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.567331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.567331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.567331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.567331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.567331] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cc9edd3-ec13-4776-b83d-312440c75c07',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.567844] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-29726e4c-6af7-42a8-9a4a-cd9a73ac77b0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.567844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29726e4c-6af7-42a8-9a4a-cd9a73ac77b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.567963] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29726e4c-6af7-42a8-9a4a-cd9a73ac77b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.568043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29726e4c-6af7-42a8-9a4a-cd9a73ac77b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.568117] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29726e4c-6af7-42a8-9a4a-cd9a73ac77b0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.070058] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cc9edd3-ec13-4776-b83d-312440c75c07 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.070412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.070412] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cc9edd3-ec13-4776-b83d-312440c75c07',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.071288] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29726e4c-6af7-42a8-9a4a-cd9a73ac77b0 with status ACTIVE [ 805.071475] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.071589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.071678] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.071890] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.071978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.072170] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.072264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.072326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.072488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.072568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.072768] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.072858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.072917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.073136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.073220] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.073304] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29726e4c-6af7-42a8-9a4a-cd9a73ac77b0 is going to be updated. [ 805.092529] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.093500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.093500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.093500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.093500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.093500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29726e4c-6af7-42a8-9a4a-cd9a73ac77b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.467914] env[69656]: INFO networking_nsxv3.common.synchronization [req-67ca7bc7-b563-42ec-a2ae-c0d7264ca98e req-a55477fe-c7a0-40f0-94cc-c14c002e0f2a tempest-ServerExternalEventsTest-1900097374 tempest-ServerExternalEventsTest-1900097374-project-member] Enqueued Resource ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 with Priority: HIGHEST for action security_group_members [ 805.468752] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 with Priority: HIGHEST for action security_group_members [ 805.468840] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbab9cac-0394-407c-b39a-2ca9394c8a11 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.468931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.468991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.473419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.473607] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.473857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.473857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.473994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.474127] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.474229] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbab9cac-0394-407c-b39a-2ca9394c8a11',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.574820] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cc9edd3-ec13-4776-b83d-312440c75c07',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.881045] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.881822] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.881822] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.881822] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.881935] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.882028] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.882136] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.882349] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.883215] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.883215] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.883215] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.883215] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.883215] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.883494] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.883494] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.883632] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.886416] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 805.886608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.886764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.886923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.887019] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.900388] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.900560] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 805.900698] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.900866] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.901183] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-79829d02-a516-4932-8a37-cd6aa65f96fd taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.901356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-79829d02-a516-4932-8a37-cd6aa65f96fd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.901475] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-79829d02-a516-4932-8a37-cd6aa65f96fd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.901796] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-79829d02-a516-4932-8a37-cd6aa65f96fd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.901937] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79829d02-a516-4932-8a37-cd6aa65f96fd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.976868] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.977050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.977125] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.977376] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.977479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.977691] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.977798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.977832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.977986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.978076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.978160] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 already deleted. [ 805.978236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.076661] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.077033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.077033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.077230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.077346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.077492] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 is going to be created. [ 806.100501] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.100683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.100812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.101114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.101352] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.110545] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 in Status: UNINITIALIZED for 2s [ 806.367746] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: SUCCESS [ 806.367986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.388771] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.388983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.389042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.389285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.389460] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.389579] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.389644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.389808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.389894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.389981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.390082] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.404131] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.404319] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.404439] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.404733] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.404882] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.405138] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 79829d02-a516-4932-8a37-cd6aa65f96fd not found, creating... [ 806.405349] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.405573] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.405654] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.405863] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.405998] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.407356] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.407356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.407356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.407356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.407356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.407356] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 79829d02-a516-4932-8a37-cd6aa65f96fd is going to be created. [ 806.429012] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.429173] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.429320] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.429591] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.429820] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.430046] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-79829d02-a516-4932-8a37-cd6aa65f96fd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.893031] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.893163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.893264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.893481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.893658] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.893756] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.893818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.893956] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.894055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.894142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.894374] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.894501] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.894582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.894783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.895075] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.895207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.895290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.895459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.895557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.895659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.895778] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.242103] env[69656]: INFO networking_nsxv3.common.synchronization [req-67ca7bc7-b563-42ec-a2ae-c0d7264ca98e req-d4551f08-5bce-4462-af08-e70657f8fb65 service nova] Enqueued Resource ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 with Priority: HIGHEST for action security_group_rules [ 807.242628] env[69656]: INFO networking_nsxv3.common.synchronization [req-67ca7bc7-b563-42ec-a2ae-c0d7264ca98e req-d4551f08-5bce-4462-af08-e70657f8fb65 service nova] Enqueued Resource ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 with Priority: HIGHEST for action security_group_members [ 807.242628] env[69656]: INFO networking_nsxv3.common.synchronization [req-67ca7bc7-b563-42ec-a2ae-c0d7264ca98e req-d4551f08-5bce-4462-af08-e70657f8fb65 service nova] Enqueued Resource ID: 79829d02-a516-4932-8a37-cd6aa65f96fd with Priority: HIGHEST for action port [ 807.242823] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 with Priority: HIGHEST for action security_group_rules [ 807.243046] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 with Priority: HIGHEST for action security_group_members [ 807.243182] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79829d02-a516-4932-8a37-cd6aa65f96fd with Priority: HIGHEST for action port [ 807.243738] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbab9cac-0394-407c-b39a-2ca9394c8a11 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.243902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.243998] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.244260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.244374] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbab9cac-0394-407c-b39a-2ca9394c8a11',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.245333] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbab9cac-0394-407c-b39a-2ca9394c8a11 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.245451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.245559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.245759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.245939] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.246075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.246160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.246332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.248561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.248561] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbab9cac-0394-407c-b39a-2ca9394c8a11',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.248561] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-79829d02-a516-4932-8a37-cd6aa65f96fd taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.248561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79829d02-a516-4932-8a37-cd6aa65f96fd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.248561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79829d02-a516-4932-8a37-cd6aa65f96fd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.248561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79829d02-a516-4932-8a37-cd6aa65f96fd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.248561] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79829d02-a516-4932-8a37-cd6aa65f96fd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.398174] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22763ac9-09b1-45ba-b8a9-6df4fc54e141: rpc.has_security_group_logging(os_id): False [ 807.416445] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.416672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.416778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.417010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.417117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.417333] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.417444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.417507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.417663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.417742] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.417933] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.418069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.418109] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.418231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.418305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.418496] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.418587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.418646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.418780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.418853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.418937] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 807.473972] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.474126] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.474229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.474364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.474509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.486702] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 807.750859] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbab9cac-0394-407c-b39a-2ca9394c8a11 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.750859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.750859] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbab9cac-0394-407c-b39a-2ca9394c8a11',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.751762] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79829d02-a516-4932-8a37-cd6aa65f96fd with status ACTIVE [ 807.751938] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.752064] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.752130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.752328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.752530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.752746] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.752854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.752922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.753110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.753196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.753413] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.753527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.753590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.753741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.753818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.753903] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79829d02-a516-4932-8a37-cd6aa65f96fd is going to be updated. [ 807.775016] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.775149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.775187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.775352] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.775473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.775616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79829d02-a516-4932-8a37-cd6aa65f96fd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.120679] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 in Status: UNINITIALIZED for 4s [ 808.256364] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbab9cac-0394-407c-b39a-2ca9394c8a11',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.759505] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.759759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.759759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.760014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.760115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.760223] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 is going to be created. [ 808.784455] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.784655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.784655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.784940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.785288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.796211] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 in Status: UNINITIALIZED for 2s [ 809.502069] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 809.502331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.130157] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 in Status: SUCCESS [ 810.130481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.130704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.130969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.131194] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.131333] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.131400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.131575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.131686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.131785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.131876] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cc9edd3-ec13-4776-b83d-312440c75c07',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.634552] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cc9edd3-ec13-4776-b83d-312440c75c07 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.635045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.635045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.635045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.635622] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.635736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.635794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.636046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.636046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.636188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.636283] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cc9edd3-ec13-4776-b83d-312440c75c07 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.636369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.636435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.636566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.636701] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.636789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.636841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.637060] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.637208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.637280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.637372] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cc9edd3-ec13-4776-b83d-312440c75c07',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.805416] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 in Status: SUCCESS [ 810.805635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.805791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.805994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.806195] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.806308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.806372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.806518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.806602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.806713] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.806766] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbab9cac-0394-407c-b39a-2ca9394c8a11',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.139107] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cc9edd3-ec13-4776-b83d-312440c75c07: rpc.has_security_group_logging(os_id): False [ 811.156032] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.156247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.156333] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.156569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.156667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.156881] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.157054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.157054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.157238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.157415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.157546] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.157679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.157744] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.157902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.157972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.158540] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.158540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.158540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.158540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.158755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.158755] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 is going to be created. [ 811.215675] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.215891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.215995] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.216296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.216541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.227663] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 in Status: IN_PROGRESS for 2s [ 811.309521] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbab9cac-0394-407c-b39a-2ca9394c8a11 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.309736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.309807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.310065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.310301] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.310447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.310545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.310757] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.310850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.310948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.311128] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbab9cac-0394-407c-b39a-2ca9394c8a11 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.311226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.311288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.311460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.311730] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.311873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.311943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.312156] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.312247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.312337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.312441] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbab9cac-0394-407c-b39a-2ca9394c8a11',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.814853] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbab9cac-0394-407c-b39a-2ca9394c8a11: rpc.has_security_group_logging(os_id): False [ 811.832259] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.832411] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.832469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.832674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.832766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.832978] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.833093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.833158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.833307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.833386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.833561] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.833648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.833703] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.833842] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.833916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.834103] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.834197] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.834262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.834394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.834469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.834551] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 is going to be created. [ 811.887466] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.887612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.887683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.887893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.888091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.897501] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 in Status: IN_PROGRESS for 2s [ 812.244493] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 812.244493] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 813.238791] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 in Status: SUCCESS [ 813.239095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.910367] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 in Status: SUCCESS [ 813.910623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.723238] env[69656]: INFO networking_nsxv3.common.synchronization [req-ff5c6c1b-d0ba-4e05-90b9-4461152117b1 req-34053c90-ba64-4ad5-a24b-281b57d56a44 tempest-InstanceActionsV221TestJSON-860969385 tempest-InstanceActionsV221TestJSON-860969385-project-member] Enqueued Resource ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 with Priority: HIGHEST for action security_group_members [ 814.723905] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 with Priority: HIGHEST for action security_group_members [ 814.724059] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cc9edd3-ec13-4776-b83d-312440c75c07 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.724181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.724246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.724438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.724585] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.724679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.724741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.724880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.724965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.725068] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cc9edd3-ec13-4776-b83d-312440c75c07',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.230065] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.230065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.230065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.230065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.230065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.230065] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.230065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.230065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.230065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.230065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.230065] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 is going to be updated. [ 815.260738] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.261267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.261267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.261267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.261418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.269470] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 in Status: IN_PROGRESS for 2s [ 817.236394] env[69656]: INFO networking_nsxv3.common.synchronization [req-4f031fb8-e95b-47cf-9d80-780d89101b95 req-7ea829da-8186-4480-b0e5-fdd3469ff16f tempest-ServerExternalEventsTest-1900097374 tempest-ServerExternalEventsTest-1900097374-project-member] Enqueued Resource ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 with Priority: HIGHEST for action security_group_members [ 817.236928] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 with Priority: HIGHEST for action security_group_members [ 817.237296] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbab9cac-0394-407c-b39a-2ca9394c8a11 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.237431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.237501] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.237697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.237849] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.237943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.238101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.239968] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.240155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.240205] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbab9cac-0394-407c-b39a-2ca9394c8a11',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.284025] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 in Status: SUCCESS [ 817.284025] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 deletion is rescheduled due to dependency. [ 817.284025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.742921] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.743093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.743209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.743406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.743453] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.743672] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.743727] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.743790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.743932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.744010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.744095] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 is going to be updated. [ 817.777252] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.777252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.777252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.777252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.777252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.785727] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 in Status: IN_PROGRESS for 2s [ 818.753138] env[69656]: INFO networking_nsxv3.common.synchronization [req-43f4a9d3-b7a0-4092-8185-e63c10a225ad req-345cee5f-1d21-41be-b3f3-1830176040a5 tempest-ServerActionsTestOtherB-109014868 tempest-ServerActionsTestOtherB-109014868-project-member] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 818.753138] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 818.753138] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.753138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.753138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.753138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.753138] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.753138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.753138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.753138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.753138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.754860] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.162534] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.162831] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.162924] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.163292] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.163484] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.163643] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.163776] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.164220] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.164220] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.164327] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.164472] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.164530] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.164632] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.164744] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.164847] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.165237] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.184054] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.184245] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 819.184428] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.184652] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.184987] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-db78c5ea-f3e7-4d0f-8017-daa2d9e951c0 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.185197] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-db78c5ea-f3e7-4d0f-8017-daa2d9e951c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.185339] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-db78c5ea-f3e7-4d0f-8017-daa2d9e951c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.185660] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-db78c5ea-f3e7-4d0f-8017-daa2d9e951c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.186280] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db78c5ea-f3e7-4d0f-8017-daa2d9e951c0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.260162] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.260329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.260495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.260662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.260739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.260945] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.261067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.261119] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.261286] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.261362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.261443] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 already deleted. [ 819.261520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.689641] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.689863] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.690145] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.690703] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.692899] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.692899] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port db78c5ea-f3e7-4d0f-8017-daa2d9e951c0 not found, creating... [ 819.692899] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.692899] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.692899] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.692899] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.692899] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.692899] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.693440] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.693440] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.693440] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.693522] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.694132] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: db78c5ea-f3e7-4d0f-8017-daa2d9e951c0 is going to be created. [ 819.712382] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.712591] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.712787] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.713522] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.713522] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.713689] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-db78c5ea-f3e7-4d0f-8017-daa2d9e951c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.796189] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 in Status: SUCCESS [ 819.796189] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 deletion is rescheduled due to dependency. [ 819.796189] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.529913] env[69656]: INFO networking_nsxv3.common.synchronization [req-43f4a9d3-b7a0-4092-8185-e63c10a225ad req-a6a8a045-fc46-4520-ab5c-296a34500e13 service nova] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_rules [ 820.530103] env[69656]: INFO networking_nsxv3.common.synchronization [req-43f4a9d3-b7a0-4092-8185-e63c10a225ad req-a6a8a045-fc46-4520-ab5c-296a34500e13 service nova] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 820.530295] env[69656]: INFO networking_nsxv3.common.synchronization [req-43f4a9d3-b7a0-4092-8185-e63c10a225ad req-a6a8a045-fc46-4520-ab5c-296a34500e13 service nova] Enqueued Resource ID: db78c5ea-f3e7-4d0f-8017-daa2d9e951c0 with Priority: HIGHEST for action port [ 820.530464] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_rules [ 820.530593] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 820.530753] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db78c5ea-f3e7-4d0f-8017-daa2d9e951c0 with Priority: HIGHEST for action port [ 820.531281] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.531403] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.531471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.531660] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.532395] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.533437] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.533554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.533633] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.533799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.533944] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.536215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.536401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.536473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.536657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.536720] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.537497] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-db78c5ea-f3e7-4d0f-8017-daa2d9e951c0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.537605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db78c5ea-f3e7-4d0f-8017-daa2d9e951c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.537707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db78c5ea-f3e7-4d0f-8017-daa2d9e951c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.537823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db78c5ea-f3e7-4d0f-8017-daa2d9e951c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.537897] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db78c5ea-f3e7-4d0f-8017-daa2d9e951c0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.777171] env[69656]: INFO networking_nsxv3.common.synchronization [None req-208e4b27-d0ec-49d8-b669-8251ac019480 None None] Enqueued Resource ID: 9ad3967c-2911-4983-968b-07938860a685 with Priority: HIGHEST for action port [ 820.777171] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ad3967c-2911-4983-968b-07938860a685 with Priority: HIGHEST for action port [ 820.777171] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ad3967c-2911-4983-968b-07938860a685 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.777171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ad3967c-2911-4983-968b-07938860a685" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.777171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ad3967c-2911-4983-968b-07938860a685" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.777778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ad3967c-2911-4983-968b-07938860a685" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.778030] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ad3967c-2911-4983-968b-07938860a685',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.043364] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.044454] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.044454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.044645] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db78c5ea-f3e7-4d0f-8017-daa2d9e951c0 with status ACTIVE [ 821.044795] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.044903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.044938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.045138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.045228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.045400] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.045496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.045558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.045702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.045780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.045957] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.046060] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.046121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.046255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.046327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.046410] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db78c5ea-f3e7-4d0f-8017-daa2d9e951c0 is going to be updated. [ 821.067083] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.067235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.067307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.067538] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.067673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.067833] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db78c5ea-f3e7-4d0f-8017-daa2d9e951c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.279922] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ad3967c-2911-4983-968b-07938860a685 [ 821.280169] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.280343] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.280423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.280598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.280692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.280785] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ad3967c-2911-4983-968b-07938860a685 already deleted. [ 821.280957] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ad3967c-2911-4983-968b-07938860a685" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.505845] env[69656]: INFO networking_nsxv3.common.synchronization [req-5f33ff19-755e-4173-a899-bd05ac58488f req-26f998de-2a17-4760-b664-d08bddbbcc1d tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 821.506370] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 821.506830] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.506830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.506985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.508738] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.508916] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.509039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.509106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.509269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.509346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.509483] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.548967] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.013345] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.013345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.013345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.013345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.013345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.013345] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.013345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.013345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.013345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.013345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.013345] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 already deleted. [ 822.013345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.028941] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-190 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.029242] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-190" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.029400] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-190" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.030038] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-190" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.031268] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.031268] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.031268] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.031268] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.031268] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.031268] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.031268] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.031268] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.031268] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.031781] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.031781] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.031781] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.048803] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.049049] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 822.049125] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.049274] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-190" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.049770] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-09adfda3-4198-41dc-8c46-f9763f2e1b14 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.049770] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.049987] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.050214] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.050353] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09adfda3-4198-41dc-8c46-f9763f2e1b14',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.052893] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.052893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.053622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.053622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.053622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.053774] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be created. [ 822.078023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.078509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.078991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.079976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.080433] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.089476] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: UNINITIALIZED for 2s [ 822.558829] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.558829] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.558829] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.558829] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.558829] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.558829] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 09adfda3-4198-41dc-8c46-f9763f2e1b14 not found, creating... [ 822.558829] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.558829] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.558829] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.558829] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.558829] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.559294] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.559294] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.559294] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.559294] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.559425] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.559532] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 09adfda3-4198-41dc-8c46-f9763f2e1b14 is going to be created. [ 822.579676] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.579909] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.580070] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.580363] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.580645] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.580888] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.944432] env[69656]: INFO networking_nsxv3.common.synchronization [None req-70d3ed64-5a85-4d0c-8189-55081afabf81 None None] Enqueued Resource ID: efd87d27-e571-40cc-bb37-fc302d97e60d with Priority: HIGHEST for action port [ 822.944995] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd87d27-e571-40cc-bb37-fc302d97e60d with Priority: HIGHEST for action port [ 822.945360] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-efd87d27-e571-40cc-bb37-fc302d97e60d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.949520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efd87d27-e571-40cc-bb37-fc302d97e60d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.949520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efd87d27-e571-40cc-bb37-fc302d97e60d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.949520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efd87d27-e571-40cc-bb37-fc302d97e60d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.949520] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efd87d27-e571-40cc-bb37-fc302d97e60d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.447884] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port efd87d27-e571-40cc-bb37-fc302d97e60d [ 823.448131] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.448263] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.448341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.448569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.448665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.448759] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:efd87d27-e571-40cc-bb37-fc302d97e60d already deleted. [ 823.448837] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efd87d27-e571-40cc-bb37-fc302d97e60d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.565813] env[69656]: INFO networking_nsxv3.common.synchronization [req-5f33ff19-755e-4173-a899-bd05ac58488f req-c87d9530-b269-4317-a09f-f6145dc37898 service nova] Enqueued Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_rules [ 823.565986] env[69656]: INFO networking_nsxv3.common.synchronization [req-5f33ff19-755e-4173-a899-bd05ac58488f req-c87d9530-b269-4317-a09f-f6145dc37898 service nova] Enqueued Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 823.566144] env[69656]: INFO networking_nsxv3.common.synchronization [req-5f33ff19-755e-4173-a899-bd05ac58488f req-c87d9530-b269-4317-a09f-f6145dc37898 service nova] Enqueued Resource ID: 09adfda3-4198-41dc-8c46-f9763f2e1b14 with Priority: HIGHEST for action port [ 823.567037] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_rules [ 823.569124] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 823.569486] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09adfda3-4198-41dc-8c46-f9763f2e1b14 with Priority: HIGHEST for action port [ 823.570767] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.570767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.570767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.570767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.570767] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.572460] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.574128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.574128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.574128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.574128] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.574128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.574128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.574128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.574128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.574128] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.575557] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-09adfda3-4198-41dc-8c46-f9763f2e1b14 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.575698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.575786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.576048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.576956] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09adfda3-4198-41dc-8c46-f9763f2e1b14',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.847950] env[69656]: INFO networking_nsxv3.common.synchronization [None req-c565a422-67a7-4b71-b911-28d3ad89c97d None None] Enqueued Resource ID: befdfbd6-37b0-4673-af24-3a45f8b71864 with Priority: HIGHEST for action port [ 823.849465] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: befdfbd6-37b0-4673-af24-3a45f8b71864 with Priority: HIGHEST for action port [ 823.849465] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-befdfbd6-37b0-4673-af24-3a45f8b71864 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.849465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-befdfbd6-37b0-4673-af24-3a45f8b71864" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.849465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-befdfbd6-37b0-4673-af24-3a45f8b71864" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.851433] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-befdfbd6-37b0-4673-af24-3a45f8b71864" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.851433] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('befdfbd6-37b0-4673-af24-3a45f8b71864',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.081653] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.081653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.081653] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.081653] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09adfda3-4198-41dc-8c46-f9763f2e1b14 with status ACTIVE [ 824.081653] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.081653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.081653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.081653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.081653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.081653] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.081653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.081653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.081653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.081653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.083047] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.083326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.083515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.084121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.084358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.084586] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09adfda3-4198-41dc-8c46-f9763f2e1b14 is going to be updated. [ 824.098221] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: SUCCESS [ 824.098912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.099241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.101051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.101051] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.101051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.101051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.101051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.101051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.101051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.101051] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.105080] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.105620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.105793] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.106482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.106482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.106834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.353141] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port befdfbd6-37b0-4673-af24-3a45f8b71864 [ 824.353141] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.353141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.353141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.353141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.353141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.353141] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:befdfbd6-37b0-4673-af24-3a45f8b71864 already deleted. [ 824.353141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-befdfbd6-37b0-4673-af24-3a45f8b71864" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.589198] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.602369] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.732884] env[69656]: INFO networking_nsxv3.common.synchronization [req-32fdf4f3-d76b-423b-8685-f6989d8f98bd req-8d6739b1-5c1a-4ca6-972c-ba00c16ac70a tempest-VolumesAssistedSnapshotsTest-538466738 tempest-VolumesAssistedSnapshotsTest-538466738-project-member] Enqueued Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGHEST for action security_group_members [ 824.733538] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGHEST for action security_group_members [ 824.734311] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb99eac5-5acc-4d01-82c2-7167ff647d1f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.734311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.735524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.735815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.735995] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.736183] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.736233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.736480] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.736608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.736730] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.091133] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.091556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.091697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.092116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.092116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.092212] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 is going to be created. [ 825.107870] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ed397b9-8a6a-442e-a200-45439f9f86d9: rpc.has_security_group_logging(os_id): False [ 825.121260] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.121385] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.121385] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.121599] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.121755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.125117] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.125117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.125117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.125276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.125490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.125574] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.125660] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.125713] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.125851] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.125923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.126018] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be created. [ 825.136225] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: UNINITIALIZED for 2s [ 825.181310] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.181607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.181607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.182301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.183137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.197046] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: IN_PROGRESS for 2s [ 825.244088] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.244088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.244088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.245190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.245190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.245190] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.245190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.245190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.245190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.245190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.245190] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f already deleted. [ 825.245655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.350376] env[69656]: INFO networking_nsxv3.common.synchronization [None req-17855f4f-c848-4f23-a74e-643e2c03f1ab tempest-VolumesAdminNegativeTest-952299599 tempest-VolumesAdminNegativeTest-952299599-project-member] Enqueued Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGHEST for action security_group_rules [ 825.350951] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGHEST for action security_group_rules [ 825.351259] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-520db785-680d-4180-b916-bfbc19204d31 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.351379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.351446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.351676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.351756] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.437033] env[69656]: INFO networking_nsxv3.common.synchronization [None req-015d6eb8-6480-4e72-a84d-14848c668bfe tempest-VolumesAdminNegativeTest-952299599 tempest-VolumesAdminNegativeTest-952299599-project-member] Enqueued Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGHEST for action security_group_rules [ 825.437033] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGHEST for action security_group_rules [ 825.438085] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-520db785-680d-4180-b916-bfbc19204d31 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.438273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.700895] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-90 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.701192] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.701229] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.701534] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.701791] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.704463] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.704463] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.704709] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.704837] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.705066] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.705181] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.705777] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.705777] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.705777] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.705777] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.705777] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.724181] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.724435] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 825.724617] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.724849] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.726790] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-fdad688e-0ac3-4570-924c-0b70f5817b5e taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.726790] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-fdad688e-0ac3-4570-924c-0b70f5817b5e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.726790] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-fdad688e-0ac3-4570-924c-0b70f5817b5e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.726790] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-fdad688e-0ac3-4570-924c-0b70f5817b5e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.726790] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdad688e-0ac3-4570-924c-0b70f5817b5e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.870487] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.871510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.871510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.871510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.871510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.871510] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 520db785-680d-4180-b916-bfbc19204d31 already deleted. [ 825.871510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.871510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.871871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.871871] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.203468] env[69656]: INFO networking_nsxv3.common.synchronization [None req-935302c7-1572-48d0-b1fa-a2c9295c13d9 None None] Enqueued Resource ID: 223ad306-b593-4fbd-a8bb-5dda68a6f5e1 with Priority: HIGHEST for action port [ 826.203809] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 223ad306-b593-4fbd-a8bb-5dda68a6f5e1 with Priority: HIGHEST for action port [ 826.205418] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-223ad306-b593-4fbd-a8bb-5dda68a6f5e1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.205418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-223ad306-b593-4fbd-a8bb-5dda68a6f5e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.205418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-223ad306-b593-4fbd-a8bb-5dda68a6f5e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.205659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-223ad306-b593-4fbd-a8bb-5dda68a6f5e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.205659] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('223ad306-b593-4fbd-a8bb-5dda68a6f5e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.230511] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.230511] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.230705] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.230881] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.231047] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.231213] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port fdad688e-0ac3-4570-924c-0b70f5817b5e not found, creating... [ 826.231479] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.231642] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.231757] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.231970] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.232123] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.232396] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.233373] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.233373] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.233373] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.233373] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.233373] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: fdad688e-0ac3-4570-924c-0b70f5817b5e is going to be created. [ 826.256439] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.256641] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.256816] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.257111] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.257688] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.257688] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-fdad688e-0ac3-4570-924c-0b70f5817b5e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.414028] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.414028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.414028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.414028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.414028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.414028] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 520db785-680d-4180-b916-bfbc19204d31 already deleted. [ 826.414028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.711171] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 223ad306-b593-4fbd-a8bb-5dda68a6f5e1 [ 826.711171] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.711171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.711171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.711171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.711529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.711529] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:223ad306-b593-4fbd-a8bb-5dda68a6f5e1 already deleted. [ 826.711529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-223ad306-b593-4fbd-a8bb-5dda68a6f5e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.805112] env[69656]: INFO networking_nsxv3.common.synchronization [req-0d816b0f-5871-4b78-a490-3e37f017f7ce req-21f276da-d880-414a-af92-1f1542f4fc00 tempest-ImagesTestJSON-514277302 tempest-ImagesTestJSON-514277302-project-member] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 826.805636] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 826.805924] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.806054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.806132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.806325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.806469] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.806567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.806628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.806767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.806849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.806953] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.118514] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.118514] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.118514] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.118770] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.122030] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.122171] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.122617] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.122743] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.122873] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.123999] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.123999] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.123999] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.123999] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.123999] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.123999] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.123999] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.147316] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: SUCCESS [ 827.147316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.147884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.148052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.148291] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.148463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.148541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.148725] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.148821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.148940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.149051] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.154472] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.154918] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 827.155095] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.155304] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.155561] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-6fb9e36a-08d6-4d88-9dc9-0ceefd60908b taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.155901] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-6fb9e36a-08d6-4d88-9dc9-0ceefd60908b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.155901] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-6fb9e36a-08d6-4d88-9dc9-0ceefd60908b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.156236] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-6fb9e36a-08d6-4d88-9dc9-0ceefd60908b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.156409] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fb9e36a-08d6-4d88-9dc9-0ceefd60908b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.217845] env[69656]: INFO networking_nsxv3.common.synchronization [req-32fdf4f3-d76b-423b-8685-f6989d8f98bd req-162864e0-ba31-435b-add6-1e3c5759c6e0 service nova] Enqueued Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGHEST for action security_group_rules [ 827.217845] env[69656]: INFO networking_nsxv3.common.synchronization [req-32fdf4f3-d76b-423b-8685-f6989d8f98bd req-162864e0-ba31-435b-add6-1e3c5759c6e0 service nova] Enqueued Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGHEST for action security_group_members [ 827.217845] env[69656]: INFO networking_nsxv3.common.synchronization [req-32fdf4f3-d76b-423b-8685-f6989d8f98bd req-162864e0-ba31-435b-add6-1e3c5759c6e0 service nova] Enqueued Resource ID: fdad688e-0ac3-4570-924c-0b70f5817b5e with Priority: HIGHEST for action port [ 827.218629] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: SUCCESS [ 827.219464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.220299] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGHEST for action security_group_rules [ 827.221135] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGHEST for action security_group_members [ 827.221135] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdad688e-0ac3-4570-924c-0b70f5817b5e with Priority: HIGHEST for action port [ 827.222902] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.222902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.222902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.222902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.222902] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.223868] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb99eac5-5acc-4d01-82c2-7167ff647d1f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.224116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.224406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.224674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.224933] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.225182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.225340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.225689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.225991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.226697] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.227098] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdad688e-0ac3-4570-924c-0b70f5817b5e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.227348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdad688e-0ac3-4570-924c-0b70f5817b5e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.227549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdad688e-0ac3-4570-924c-0b70f5817b5e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.227815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdad688e-0ac3-4570-924c-0b70f5817b5e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.228073] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdad688e-0ac3-4570-924c-0b70f5817b5e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.311035] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.311154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.311154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.312091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.312091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.312091] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.312091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.312091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.312091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.312091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.312091] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 827.334243] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.334243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.334362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.334661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.334792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.346030] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 827.652537] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.652732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.652766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.652967] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.653128] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.653227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.653289] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.653433] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.653522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.653608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.653745] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.653836] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.653910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.654061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.654162] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.654273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.654314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.654450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.654495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.654573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.655071] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.658486] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.658703] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.658851] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.659124] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.659346] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.659447] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 6fb9e36a-08d6-4d88-9dc9-0ceefd60908b not found, creating... [ 827.659759] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.659934] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.660239] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.660492] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.660664] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.660961] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.661215] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.661269] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.661482] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.661624] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.661777] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 6fb9e36a-08d6-4d88-9dc9-0ceefd60908b is going to be created. [ 827.694651] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.694967] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.695164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.695408] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.695724] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.696055] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-6fb9e36a-08d6-4d88-9dc9-0ceefd60908b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.724449] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb99eac5-5acc-4d01-82c2-7167ff647d1f taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.724449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.736118] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fdad688e-0ac3-4570-924c-0b70f5817b5e with status ACTIVE [ 827.736118] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.736118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.736118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.736118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.736118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.736118] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.736118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.736118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.736118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.736118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.736118] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.736118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.736118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.736118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.736118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.736118] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fdad688e-0ac3-4570-924c-0b70f5817b5e is going to be updated. [ 827.736825] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.770556] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.770556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.770556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.770556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.770556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.770556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdad688e-0ac3-4570-924c-0b70f5817b5e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.158868] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39d79c92-ce40-4ea6-bf34-2e0fcc875300: rpc.has_security_group_logging(os_id): False [ 828.176598] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.176598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.176598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.176598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.176598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.176598] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.176598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.176598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.176598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.176598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.176598] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.176598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.176598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.176598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.176598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.177128] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.177128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.177128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.177128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.177128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.177128] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 is going to be created. [ 828.245295] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.249516] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.249516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.249516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.249516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.249516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.261703] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: IN_PROGRESS for 2s [ 828.343948] env[69656]: INFO networking_nsxv3.common.synchronization [req-0d816b0f-5871-4b78-a490-3e37f017f7ce req-82506709-ac87-4af7-a412-55d8b937dbf7 service nova] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_rules [ 828.344690] env[69656]: INFO networking_nsxv3.common.synchronization [req-0d816b0f-5871-4b78-a490-3e37f017f7ce req-82506709-ac87-4af7-a412-55d8b937dbf7 service nova] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 828.345222] env[69656]: INFO networking_nsxv3.common.synchronization [req-0d816b0f-5871-4b78-a490-3e37f017f7ce req-82506709-ac87-4af7-a412-55d8b937dbf7 service nova] Enqueued Resource ID: 6fb9e36a-08d6-4d88-9dc9-0ceefd60908b with Priority: HIGHEST for action port [ 828.347536] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_rules [ 828.347536] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 828.347536] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fb9e36a-08d6-4d88-9dc9-0ceefd60908b with Priority: HIGHEST for action port [ 828.347536] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.347536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.347536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.347536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.347536] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.353119] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.353119] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.353119] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fb9e36a-08d6-4d88-9dc9-0ceefd60908b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.353119] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fb9e36a-08d6-4d88-9dc9-0ceefd60908b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.353119] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fb9e36a-08d6-4d88-9dc9-0ceefd60908b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.353119] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fb9e36a-08d6-4d88-9dc9-0ceefd60908b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.353119] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fb9e36a-08d6-4d88-9dc9-0ceefd60908b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.751255] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.751547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.751547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.751681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.751776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.751895] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f is going to be created. [ 828.773805] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.773986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.774082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.774295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.774457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.785234] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f in Status: UNINITIALIZED for 2s [ 828.852994] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.853943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.856733] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fb9e36a-08d6-4d88-9dc9-0ceefd60908b with status ACTIVE [ 828.857018] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.857312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.857312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.860463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.860463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.860463] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.860463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.860463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.860463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.860463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.860463] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.860463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.860463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.860463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.860463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.860463] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fb9e36a-08d6-4d88-9dc9-0ceefd60908b is going to be updated. [ 828.883874] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.884038] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.884114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.884328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.884472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.884638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fb9e36a-08d6-4d88-9dc9-0ceefd60908b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.362327] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 829.362516] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e deletion is rescheduled due to dependency. [ 829.362632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.362805] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.363107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.363302] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.363423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.363488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.363649] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.363738] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.363832] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.580940] env[69656]: INFO networking_nsxv3.common.synchronization [req-ceaeb6f8-2ea2-44a2-aa0d-8f820233279c req-b2de0092-2b1d-4276-b6e1-2dbab50e1d01 tempest-ServerMetadataNegativeTestJSON-1464603032 tempest-ServerMetadataNegativeTestJSON-1464603032-project-member] Enqueued Resource ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 with Priority: HIGHEST for action security_group_members [ 829.581739] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 with Priority: HIGHEST for action security_group_members [ 829.582117] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-73af530a-6b5a-405c-a77e-a32b8c5ebc26 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.582960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.582960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.582960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.582960] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.582960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.583208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.586969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.587107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.587238] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73af530a-6b5a-405c-a77e-a32b8c5ebc26',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.867198] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.071556] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-771 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.071861] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-771" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.072800] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-771" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.073869] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-771" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.074218] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.074434] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.074558] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.075577] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.075577] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.075577] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.075577] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.075577] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.075577] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.075828] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.075828] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.075924] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.092524] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.092689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.092768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.092959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.093065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.093746] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.093746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.093746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.093746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.093746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.093746] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 already deleted. [ 830.094168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.097433] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.097672] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 830.097847] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.098090] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-771" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.098427] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-f5007b9d-c25a-47f1-9156-281c16a0db07 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.098670] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-f5007b9d-c25a-47f1-9156-281c16a0db07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.098792] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-f5007b9d-c25a-47f1-9156-281c16a0db07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.099182] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-f5007b9d-c25a-47f1-9156-281c16a0db07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.100432] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5007b9d-c25a-47f1-9156-281c16a0db07',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.272801] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: SUCCESS [ 830.273061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.370601] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.605378] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.605592] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.605688] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.605959] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.606192] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.606726] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port f5007b9d-c25a-47f1-9156-281c16a0db07 not found, creating... [ 830.606726] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.606726] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.606878] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.610020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.610020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.610020] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.610020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.610020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.610020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.610020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.610020] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: f5007b9d-c25a-47f1-9156-281c16a0db07 is going to be created. [ 830.627856] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.628074] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.628203] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.628470] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.629104] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.629104] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-f5007b9d-c25a-47f1-9156-281c16a0db07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.796063] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f in Status: SUCCESS [ 830.796304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.796528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.796713] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.796901] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.797031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.797099] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.797255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.797338] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.797441] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.797564] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.873349] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.873822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.873822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.873822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.874379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.874379] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 830.902165] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.902165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.902283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.903386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.903386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.910391] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 831.300460] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.802825] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb99eac5-5acc-4d01-82c2-7167ff647d1f: rpc.has_security_group_logging(os_id): False [ 831.819750] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.819929] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.820086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.820280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.820354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.820606] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.820727] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.820798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.820985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.821102] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.821207] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f is going to be created. [ 831.887682] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.888048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.888048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.888203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.888375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.897901] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f in Status: IN_PROGRESS for 2s [ 831.983716] env[69656]: INFO networking_nsxv3.common.synchronization [req-ceaeb6f8-2ea2-44a2-aa0d-8f820233279c req-9037a39d-b052-4706-ae92-8e600d0dc7b4 service nova] Enqueued Resource ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 with Priority: HIGHEST for action security_group_rules [ 831.983956] env[69656]: INFO networking_nsxv3.common.synchronization [req-ceaeb6f8-2ea2-44a2-aa0d-8f820233279c req-9037a39d-b052-4706-ae92-8e600d0dc7b4 service nova] Enqueued Resource ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 with Priority: HIGHEST for action security_group_members [ 831.984158] env[69656]: INFO networking_nsxv3.common.synchronization [req-ceaeb6f8-2ea2-44a2-aa0d-8f820233279c req-9037a39d-b052-4706-ae92-8e600d0dc7b4 service nova] Enqueued Resource ID: f5007b9d-c25a-47f1-9156-281c16a0db07 with Priority: HIGHEST for action port [ 831.984826] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 with Priority: HIGHEST for action security_group_rules [ 831.984990] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 with Priority: HIGHEST for action security_group_members [ 831.988788] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5007b9d-c25a-47f1-9156-281c16a0db07 with Priority: HIGHEST for action port [ 831.989188] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73af530a-6b5a-405c-a77e-a32b8c5ebc26 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.989357] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.989451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.989820] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.989938] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73af530a-6b5a-405c-a77e-a32b8c5ebc26',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.991644] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-73af530a-6b5a-405c-a77e-a32b8c5ebc26 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.991644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.991764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.991906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.999431] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.999700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.999747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.999977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.000121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.000252] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73af530a-6b5a-405c-a77e-a32b8c5ebc26',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.002374] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5007b9d-c25a-47f1-9156-281c16a0db07 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.002374] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5007b9d-c25a-47f1-9156-281c16a0db07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.002374] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5007b9d-c25a-47f1-9156-281c16a0db07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.002555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5007b9d-c25a-47f1-9156-281c16a0db07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.002555] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5007b9d-c25a-47f1-9156-281c16a0db07',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.260031] env[69656]: INFO networking_nsxv3.common.synchronization [req-200f5e2c-4dd5-485b-b1e5-757a2adc7d8f req-12a45cd8-e224-4032-9fe8-3181e809de60 tempest-MigrationsAdminTest-978699219 tempest-MigrationsAdminTest-978699219-project-member] Enqueued Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_members [ 832.260858] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_members [ 832.261483] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.261617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.261685] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.261883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.265779] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.265930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.266014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.266534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.266638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.266737] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.505027] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-73af530a-6b5a-405c-a77e-a32b8c5ebc26 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.505220] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.505369] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73af530a-6b5a-405c-a77e-a32b8c5ebc26',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.509667] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5007b9d-c25a-47f1-9156-281c16a0db07 with status ACTIVE [ 832.509667] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.509667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.509667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.509667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.509667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.509667] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.509667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.509667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.509667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.509667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.509667] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.509667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.509667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.509667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.510178] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.510178] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5007b9d-c25a-47f1-9156-281c16a0db07 is going to be updated. [ 832.528909] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.529124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.529124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.529332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.529461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.531847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5007b9d-c25a-47f1-9156-281c16a0db07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.569464] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.569617] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.569757] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.570963] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.570963] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.570963] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.570963] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.570963] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.570963] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.571373] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.571498] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.571612] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.571725] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.571835] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.571962] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.572111] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.601889] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.601889] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 832.602091] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.602091] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.602409] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-57e3d190-1bc5-4c2a-aaf7-55af4cb28e93 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.602583] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-57e3d190-1bc5-4c2a-aaf7-55af4cb28e93" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.602715] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-57e3d190-1bc5-4c2a-aaf7-55af4cb28e93" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.603029] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-57e3d190-1bc5-4c2a-aaf7-55af4cb28e93" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.603159] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57e3d190-1bc5-4c2a-aaf7-55af4cb28e93',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.768818] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.919796] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 832.920101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.920232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.920431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.920633] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.920770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.922020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.922020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.922020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.922020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.922020] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.012430] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73af530a-6b5a-405c-a77e-a32b8c5ebc26',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.105417] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.105726] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.105805] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.106121] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.106646] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.106646] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 57e3d190-1bc5-4c2a-aaf7-55af4cb28e93 not found, creating... [ 833.106934] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.107136] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.107266] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.107611] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.107744] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.107996] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.110753] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.110984] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.111194] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.111435] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.112357] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 57e3d190-1bc5-4c2a-aaf7-55af4cb28e93 is going to be created. [ 833.132733] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.132978] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.133145] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.133441] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.133684] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.133916] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-57e3d190-1bc5-4c2a-aaf7-55af4cb28e93" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.272409] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.378302] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d84df50e-6372-4b3c-8e93-0d5adfc1d2ab None None] Enqueued Resource ID: 1e5d4f3c-f60c-43a9-a9e6-f9faa5c3a654 with Priority: HIGHEST for action port [ 833.378916] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5d4f3c-f60c-43a9-a9e6-f9faa5c3a654 with Priority: HIGHEST for action port [ 833.379279] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e5d4f3c-f60c-43a9-a9e6-f9faa5c3a654 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.379438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e5d4f3c-f60c-43a9-a9e6-f9faa5c3a654" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.379522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e5d4f3c-f60c-43a9-a9e6-f9faa5c3a654" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.379899] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e5d4f3c-f60c-43a9-a9e6-f9faa5c3a654" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.380011] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e5d4f3c-f60c-43a9-a9e6-f9faa5c3a654',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.423330] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.423486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.423558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.423771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.424405] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.424579] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.424670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.424857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.424971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.425103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.425282] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.425401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.425493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.425848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.426062] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.426224] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.426403] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.426580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.426709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.426822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.426942] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.515934] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.516247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.516328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.516557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.516653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.516752] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 is going to be created. [ 833.538961] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.539131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.539202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.539409] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.539583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.550614] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 in Status: UNINITIALIZED for 2s [ 833.774676] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.774840] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.774912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.775481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.775587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.775696] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 792b043f-2560-4918-890f-99f50b059db4 is going to be updated. [ 833.803925] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.803925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.803925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.804138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.804226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.821276] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: IN_PROGRESS for 2s [ 833.883205] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e5d4f3c-f60c-43a9-a9e6-f9faa5c3a654 [ 833.885749] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.885913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.885980] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.888585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.888585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.888585] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e5d4f3c-f60c-43a9-a9e6-f9faa5c3a654 already deleted. [ 833.889466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e5d4f3c-f60c-43a9-a9e6-f9faa5c3a654" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.899130] env[69656]: INFO networking_nsxv3.common.synchronization [req-200f5e2c-4dd5-485b-b1e5-757a2adc7d8f req-8d501b53-d953-4699-9516-d46d52f3a093 service nova] Enqueued Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_rules [ 833.899130] env[69656]: INFO networking_nsxv3.common.synchronization [req-200f5e2c-4dd5-485b-b1e5-757a2adc7d8f req-8d501b53-d953-4699-9516-d46d52f3a093 service nova] Enqueued Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_members [ 833.899130] env[69656]: INFO networking_nsxv3.common.synchronization [req-200f5e2c-4dd5-485b-b1e5-757a2adc7d8f req-8d501b53-d953-4699-9516-d46d52f3a093 service nova] Enqueued Resource ID: 57e3d190-1bc5-4c2a-aaf7-55af4cb28e93 with Priority: HIGHEST for action port [ 833.899130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_rules [ 833.899130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_members [ 833.899130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e3d190-1bc5-4c2a-aaf7-55af4cb28e93 with Priority: HIGHEST for action port [ 833.900262] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.900331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.900393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.900630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.900840] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.901722] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.901827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.902056] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-57e3d190-1bc5-4c2a-aaf7-55af4cb28e93 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.902117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57e3d190-1bc5-4c2a-aaf7-55af4cb28e93" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.902161] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57e3d190-1bc5-4c2a-aaf7-55af4cb28e93" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.902332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57e3d190-1bc5-4c2a-aaf7-55af4cb28e93" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.902401] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57e3d190-1bc5-4c2a-aaf7-55af4cb28e93',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.915762] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f in Status: SUCCESS [ 833.916070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.932046] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a714e7c-1123-47f3-81e4-70f097603f3e: rpc.has_security_group_logging(os_id): False [ 833.951938] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.951938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.951938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.951938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.951938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.951938] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.951938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.951938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.951938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.951938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.951938] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.952601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.952778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.953033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.953206] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.953487] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.954292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.954461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.954758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.954915] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.955089] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 834.016131] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.016294] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.016400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.016630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.016802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.031224] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 834.404888] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.405028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.405242] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57e3d190-1bc5-4c2a-aaf7-55af4cb28e93 with status ACTIVE [ 834.405412] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.405517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.405585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.405789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.405877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.406096] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.406155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.406226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.406348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.406425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.406604] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.406688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.406753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.406891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.406966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.407062] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57e3d190-1bc5-4c2a-aaf7-55af4cb28e93 is going to be updated. [ 834.411387] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d5558de4-a750-439f-90cc-93b42afa5901 tempest-ServersTestFqdnHostnames-735452098 tempest-ServersTestFqdnHostnames-735452098-project-member] Enqueued Resource ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf with Priority: HIGHEST for action security_group_rules [ 834.412050] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf with Priority: HIGHEST for action security_group_rules [ 834.412789] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.412930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.412997] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.413249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.413363] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.429628] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.429797] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.429857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.430414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.430414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.430414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57e3d190-1bc5-4c2a-aaf7-55af4cb28e93" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.508047] env[69656]: INFO networking_nsxv3.common.synchronization [None req-b81550d8-279c-416b-89f6-6255c4baed66 tempest-ServersTestFqdnHostnames-735452098 tempest-ServersTestFqdnHostnames-735452098-project-member] Enqueued Resource ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf with Priority: HIGHEST for action security_group_rules [ 834.509401] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf with Priority: HIGHEST for action security_group_rules [ 834.509401] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.509401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.934066] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.934344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.934405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.934670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.934784] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.934926] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf already deleted. [ 834.935035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.935279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.935534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.935666] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.457838] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.457838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.457838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.457838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.457838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.457838] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf already deleted. [ 835.457838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.562097] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 in Status: SUCCESS [ 835.562097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.562097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.562097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.562097] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.562097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.562097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.562097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.562097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.562097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.562097] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73af530a-6b5a-405c-a77e-a32b8c5ebc26',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.638391] env[69656]: INFO networking_nsxv3.common.synchronization [None req-ece0c420-3cd6-4b05-9f00-ee92647e2e1b None None] Enqueued Resource ID: ef1d52df-df9f-4325-be58-e7cf4cc36034 with Priority: HIGHEST for action port [ 835.638391] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1d52df-df9f-4325-be58-e7cf4cc36034 with Priority: HIGHEST for action port [ 835.638391] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef1d52df-df9f-4325-be58-e7cf4cc36034 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.639838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef1d52df-df9f-4325-be58-e7cf4cc36034" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.640047] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef1d52df-df9f-4325-be58-e7cf4cc36034" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.641496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef1d52df-df9f-4325-be58-e7cf4cc36034" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.641496] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef1d52df-df9f-4325-be58-e7cf4cc36034',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.830955] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: SUCCESS [ 835.831201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.831368] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.831584] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.831764] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.831880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.831944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.832111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.832191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.832285] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.044864] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 836.049045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.068763] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-73af530a-6b5a-405c-a77e-a32b8c5ebc26 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.069017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.069147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.069419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.069983] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.070162] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.070270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.070704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.071355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.071543] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.072155] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-73af530a-6b5a-405c-a77e-a32b8c5ebc26 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.072339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.072595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.073272] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.074249] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.074295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.074882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.075066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.075153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.075242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.075335] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73af530a-6b5a-405c-a77e-a32b8c5ebc26',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.147120] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef1d52df-df9f-4325-be58-e7cf4cc36034 [ 836.147405] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.147405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.147405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.147614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.147660] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.147748] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef1d52df-df9f-4325-be58-e7cf4cc36034 already deleted. [ 836.147827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef1d52df-df9f-4325-be58-e7cf4cc36034" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.335791] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.513486] env[69656]: INFO networking_nsxv3.common.synchronization [req-6aaf1bf9-754e-4765-ba06-8378b2fdfbe5 req-9249688a-2431-494c-8f5a-83c29f4ba23b tempest-ServerGroupTestJSON-1584243530 tempest-ServerGroupTestJSON-1584243530-project-member] Enqueued Resource ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 with Priority: HIGHEST for action security_group_members [ 836.513670] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 with Priority: HIGHEST for action security_group_members [ 836.517043] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-759da36a-a18b-4f5f-b889-a6d7444033f4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.517043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.517043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.517043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.517043] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.517043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.517043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.517043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.517043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.517043] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('759da36a-a18b-4f5f-b889-a6d7444033f4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.578996] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73af530a-6b5a-405c-a77e-a32b8c5ebc26: rpc.has_security_group_logging(os_id): False [ 836.596620] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.596773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.596868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.597169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.597305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.597591] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.597735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.597808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.598011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.598140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.598283] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.598369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.598434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.598573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.598668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.598869] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.598968] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.599104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.599584] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.600523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.600646] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 is going to be created. [ 836.654797] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.655032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.655154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.655535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.655774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.666082] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 in Status: IN_PROGRESS for 2s [ 836.839139] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.992517] env[69656]: INFO networking_nsxv3.common.synchronization [req-4a870080-5308-4e30-874e-93204d29f351 req-28674ee7-bc00-428e-ac36-211c4d184d5d tempest-ListImageFiltersTestJSON-1291126279 tempest-ListImageFiltersTestJSON-1291126279-project-member] Enqueued Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_members [ 836.993188] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGHEST for action security_group_members [ 836.993526] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.993666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.993730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.993931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.994092] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.994182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.994240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.994380] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.995541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.995541] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.021395] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.021395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.021395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.021670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.021670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.021759] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.021845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.022955] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.022955] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.022955] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.022955] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 already deleted. [ 837.023258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.321644] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.321970] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-848" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.321970] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-848" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.322309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-848" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.322569] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.322727] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.322845] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.323087] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.323229] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.323443] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.323557] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.323670] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.323780] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.323889] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.324128] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.324128] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.341847] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.343630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.343748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.344420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.344420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.344420] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 792b043f-2560-4918-890f-99f50b059db4 is going to be updated. [ 837.346462] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.346628] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 837.346776] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.346950] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-848" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.347419] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-3cd2be69-460b-4404-be18-81896382f3d2 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.347588] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-3cd2be69-460b-4404-be18-81896382f3d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.347663] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-3cd2be69-460b-4404-be18-81896382f3d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.347994] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-3cd2be69-460b-4404-be18-81896382f3d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.348147] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cd2be69-460b-4404-be18-81896382f3d2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.378570] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.378570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.378570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.378821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.378877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.394110] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: IN_PROGRESS for 2s [ 837.498440] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.500091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.500139] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.500429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.500592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.501180] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.501180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.501313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.501451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.501585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.501730] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 is going to be updated. [ 837.556026] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.556026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.556026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.556026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.556026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.567084] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: IN_PROGRESS for 2s [ 837.851945] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.852228] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.852410] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.852833] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.853072] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.853312] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 3cd2be69-460b-4404-be18-81896382f3d2 not found, creating... [ 837.853628] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.853827] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.853997] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.854318] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.854506] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.854868] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.855104] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.855282] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.855536] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.855701] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.855898] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 3cd2be69-460b-4404-be18-81896382f3d2 is going to be created. [ 837.882021] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.882021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.882021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.882021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.882021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.882021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-3cd2be69-460b-4404-be18-81896382f3d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.033901] env[69656]: INFO networking_nsxv3.common.synchronization [req-6931a28f-46ff-4dec-8bba-f1627686415e req-e05fd9ea-288d-4b80-96d3-7b962e3a8a08 tempest-ListServerFiltersTestJSON-1060652857 tempest-ListServerFiltersTestJSON-1060652857-project-member] Enqueued Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 838.034665] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 838.036883] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.036883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.036883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.036883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.036883] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.036883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.036883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.036883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.036883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.036883] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.539843] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.540210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.540210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.540345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.540424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.540620] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.542775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.542775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.542775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.542775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.542992] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d already deleted. [ 838.542992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.677201] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 in Status: SUCCESS [ 838.677459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.405023] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: SUCCESS [ 839.405023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.405023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.405023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.405023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.405023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.405023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.405023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.405023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.405023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.405023] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.506343] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-807 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.506540] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-807" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.506666] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-807" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.507008] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-807" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.507278] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.507437] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.507666] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.507900] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.508382] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.508670] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.508837] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.509107] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.509107] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.509277] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.509411] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.509706] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.528454] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.528622] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 839.528802] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.529133] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-807" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.529515] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-860506e3-0514-407c-807f-68e1b9d252b5 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.529748] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-860506e3-0514-407c-807f-68e1b9d252b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.529906] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-860506e3-0514-407c-807f-68e1b9d252b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.530222] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-860506e3-0514-407c-807f-68e1b9d252b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.530364] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('860506e3-0514-407c-807f-68e1b9d252b5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.576344] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 in Status: SUCCESS [ 839.576615] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 deletion is rescheduled due to dependency. [ 839.576701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.692391] env[69656]: INFO networking_nsxv3.common.synchronization [req-6aaf1bf9-754e-4765-ba06-8378b2fdfbe5 req-6e902f15-ae6f-4aef-a64f-7558d1b893d1 service nova] Enqueued Resource ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 with Priority: HIGHEST for action security_group_rules [ 839.692391] env[69656]: INFO networking_nsxv3.common.synchronization [req-6aaf1bf9-754e-4765-ba06-8378b2fdfbe5 req-6e902f15-ae6f-4aef-a64f-7558d1b893d1 service nova] Enqueued Resource ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 with Priority: HIGHEST for action security_group_members [ 839.692391] env[69656]: INFO networking_nsxv3.common.synchronization [req-6aaf1bf9-754e-4765-ba06-8378b2fdfbe5 req-6e902f15-ae6f-4aef-a64f-7558d1b893d1 service nova] Enqueued Resource ID: 3cd2be69-460b-4404-be18-81896382f3d2 with Priority: HIGHEST for action port [ 839.692559] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 with Priority: HIGHEST for action security_group_rules [ 839.692738] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 with Priority: HIGHEST for action security_group_members [ 839.692772] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd2be69-460b-4404-be18-81896382f3d2 with Priority: HIGHEST for action port [ 839.693843] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-759da36a-a18b-4f5f-b889-a6d7444033f4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.693843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.693843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.693843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.694173] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('759da36a-a18b-4f5f-b889-a6d7444033f4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.694736] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-759da36a-a18b-4f5f-b889-a6d7444033f4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.696158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.696158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.696158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.696158] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.696158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.696158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.696158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.696158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.696158] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('759da36a-a18b-4f5f-b889-a6d7444033f4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.700842] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cd2be69-460b-4404-be18-81896382f3d2 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.700842] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cd2be69-460b-4404-be18-81896382f3d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.700842] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cd2be69-460b-4404-be18-81896382f3d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.700991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cd2be69-460b-4404-be18-81896382f3d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.701064] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cd2be69-460b-4404-be18-81896382f3d2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.910801] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.910801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.910801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.910801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.910801] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.911079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.911079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.911079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.911182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.911216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.912032] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.912032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.912032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.912032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.912032] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.912032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.912032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.912353] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.912353] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.912353] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.912353] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.032956] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.033202] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.033329] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.033614] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.033765] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.033918] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 860506e3-0514-407c-807f-68e1b9d252b5 not found, creating... [ 840.034198] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.034356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.034482] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.034698] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.034834] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.035733] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.036041] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.036233] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.036650] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.036958] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.037547] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 860506e3-0514-407c-807f-68e1b9d252b5 is going to be created. [ 840.082961] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.083253] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.083420] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.083799] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.084053] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.084295] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-860506e3-0514-407c-807f-68e1b9d252b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.202718] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('759da36a-a18b-4f5f-b889-a6d7444033f4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.203794] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-759da36a-a18b-4f5f-b889-a6d7444033f4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.203970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.204090] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cd2be69-460b-4404-be18-81896382f3d2 with status ACTIVE [ 840.204245] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.204354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.204418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.204640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.204729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.204901] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.205029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.205124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.205354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.205514] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.205753] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.205907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.206660] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.206867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.206956] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.207064] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cd2be69-460b-4404-be18-81896382f3d2 is going to be updated. [ 840.231729] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.232395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.232395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.233130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.233130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.233130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cd2be69-460b-4404-be18-81896382f3d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.414619] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 792b043f-2560-4918-890f-99f50b059db4: rpc.has_security_group_logging(os_id): False [ 840.432111] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.432280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.432351] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.432555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.432645] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.432848] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.432942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.433011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.433171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.433249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.433435] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.433526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.433587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.433724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.433796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.433989] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.434089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.434897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.434897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.434897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.434897] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 792b043f-2560-4918-890f-99f50b059db4 is going to be updated. [ 840.514775] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.514933] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.515048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.515282] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.515441] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.529350] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: IN_PROGRESS for 2s [ 840.656905] env[69656]: INFO networking_nsxv3.common.synchronization [req-46c0269a-1465-4e00-936f-71996c1d8d01 req-12b8df35-5471-402e-a391-d6feb612a677 tempest-ListServerFiltersTestJSON-1060652857 tempest-ListServerFiltersTestJSON-1060652857-project-member] Enqueued Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 840.657482] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 840.657817] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.657940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.658295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.658527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.658691] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.658977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.658977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.658977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.659234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.659234] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.709246] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('759da36a-a18b-4f5f-b889-a6d7444033f4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.165158] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.214988] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.215192] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.215248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.215459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.215557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.215658] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 is going to be created. [ 841.232838] env[69656]: INFO networking_nsxv3.common.synchronization [req-6931a28f-46ff-4dec-8bba-f1627686415e req-ca4db120-ec1d-44cd-bb12-e0562e8eb521 service nova] Enqueued Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_rules [ 841.232838] env[69656]: INFO networking_nsxv3.common.synchronization [req-6931a28f-46ff-4dec-8bba-f1627686415e req-ca4db120-ec1d-44cd-bb12-e0562e8eb521 service nova] Enqueued Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 841.232838] env[69656]: INFO networking_nsxv3.common.synchronization [req-6931a28f-46ff-4dec-8bba-f1627686415e req-ca4db120-ec1d-44cd-bb12-e0562e8eb521 service nova] Enqueued Resource ID: 860506e3-0514-407c-807f-68e1b9d252b5 with Priority: HIGHEST for action port [ 841.233041] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_rules [ 841.233079] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 841.233181] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 860506e3-0514-407c-807f-68e1b9d252b5 with Priority: HIGHEST for action port [ 841.233733] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.233853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.233932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.235761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.235848] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.236953] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.237074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.237373] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-860506e3-0514-407c-807f-68e1b9d252b5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.237520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-860506e3-0514-407c-807f-68e1b9d252b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.237587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-860506e3-0514-407c-807f-68e1b9d252b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.237815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-860506e3-0514-407c-807f-68e1b9d252b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.237898] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('860506e3-0514-407c-807f-68e1b9d252b5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.245294] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.245387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.246396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.246612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.246791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.257517] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 in Status: UNINITIALIZED for 2s [ 841.512474] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-807 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.513443] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-807" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.513747] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-807" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.514776] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-807" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.515306] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.515523] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.515676] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.515994] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.516224] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.516503] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.517160] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.517514] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.517943] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.518133] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.518332] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.518557] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.542044] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.542044] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 841.542044] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.542044] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-807" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.542044] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-07e37bd4-ef5b-46c7-98c4-477ca54acd62 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.542044] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-07e37bd4-ef5b-46c7-98c4-477ca54acd62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.542044] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-07e37bd4-ef5b-46c7-98c4-477ca54acd62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.542044] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-07e37bd4-ef5b-46c7-98c4-477ca54acd62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.542587] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07e37bd4-ef5b-46c7-98c4-477ca54acd62',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.670159] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.700810] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d318f9f2-76b3-4880-9bd6-b4bdeda4cf2f None None] Enqueued Resource ID: 562e687e-764a-4bfc-b642-074907dddd1f with Priority: HIGHEST for action port [ 841.701566] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562e687e-764a-4bfc-b642-074907dddd1f with Priority: HIGHEST for action port [ 841.706582] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-562e687e-764a-4bfc-b642-074907dddd1f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.706582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-562e687e-764a-4bfc-b642-074907dddd1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.706768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-562e687e-764a-4bfc-b642-074907dddd1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.707141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-562e687e-764a-4bfc-b642-074907dddd1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.707141] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('562e687e-764a-4bfc-b642-074907dddd1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.739764] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.739928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.741765] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 860506e3-0514-407c-807f-68e1b9d252b5 with status ACTIVE [ 841.741765] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.741765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.741765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.742404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.742404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.742404] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.742656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.742656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.743111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.743111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.743326] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.743394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.743456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.743621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.743675] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.743777] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 860506e3-0514-407c-807f-68e1b9d252b5 is going to be updated. [ 841.763929] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.767049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.767049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.767049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.767049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.767049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-860506e3-0514-407c-807f-68e1b9d252b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.052024] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.052024] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.052024] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.052024] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.052024] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.052024] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 07e37bd4-ef5b-46c7-98c4-477ca54acd62 not found, creating... [ 842.052024] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.052024] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.052024] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.052024] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.052024] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.052480] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.052480] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.052913] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.053367] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.053628] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.053871] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 07e37bd4-ef5b-46c7-98c4-477ca54acd62 is going to be created. [ 842.073018] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.073018] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.073961] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.074443] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.075833] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.075833] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-07e37bd4-ef5b-46c7-98c4-477ca54acd62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.169503] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.169922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.169922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.171117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.171117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.171117] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d is going to be created. [ 842.212693] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.212864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.213030] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.213283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.213440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.214448] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 562e687e-764a-4bfc-b642-074907dddd1f [ 842.217085] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.217085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.217085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.217085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.217085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.217085] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:562e687e-764a-4bfc-b642-074907dddd1f already deleted. [ 842.217085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-562e687e-764a-4bfc-b642-074907dddd1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.228851] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: UNINITIALIZED for 2s [ 842.545748] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: SUCCESS [ 842.545852] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.921504] env[69656]: INFO networking_nsxv3.common.synchronization [req-46c0269a-1465-4e00-936f-71996c1d8d01 req-bcf35968-47c5-4fa9-9b74-af4a84135155 service nova] Enqueued Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_rules [ 842.921808] env[69656]: INFO networking_nsxv3.common.synchronization [req-46c0269a-1465-4e00-936f-71996c1d8d01 req-bcf35968-47c5-4fa9-9b74-af4a84135155 service nova] Enqueued Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 842.921808] env[69656]: INFO networking_nsxv3.common.synchronization [req-46c0269a-1465-4e00-936f-71996c1d8d01 req-bcf35968-47c5-4fa9-9b74-af4a84135155 service nova] Enqueued Resource ID: 07e37bd4-ef5b-46c7-98c4-477ca54acd62 with Priority: HIGHEST for action port [ 842.921906] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_rules [ 842.922231] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 842.922231] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e37bd4-ef5b-46c7-98c4-477ca54acd62 with Priority: HIGHEST for action port [ 842.922650] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.922761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.923019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.925760] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.925862] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-07e37bd4-ef5b-46c7-98c4-477ca54acd62 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.925950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07e37bd4-ef5b-46c7-98c4-477ca54acd62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.925950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07e37bd4-ef5b-46c7-98c4-477ca54acd62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.926607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07e37bd4-ef5b-46c7-98c4-477ca54acd62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.926607] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07e37bd4-ef5b-46c7-98c4-477ca54acd62',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.272385] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 in Status: SUCCESS [ 843.272637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.272845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.273110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.273311] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.273429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.273497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.273658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.273740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.273824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.273963] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('759da36a-a18b-4f5f-b889-a6d7444033f4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.430882] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07e37bd4-ef5b-46c7-98c4-477ca54acd62 with status ACTIVE [ 843.431130] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.431260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.431324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.431538] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.431623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.431794] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.431884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.431943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.432095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.432166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.432442] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.432498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.432528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.432661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.432732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.432826] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07e37bd4-ef5b-46c7-98c4-477ca54acd62 is going to be updated. [ 843.456688] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.456823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.456892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.457118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.457250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.457407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07e37bd4-ef5b-46c7-98c4-477ca54acd62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.513083] env[69656]: INFO networking_nsxv3.common.synchronization [req-54418b40-4517-458a-b0cb-96579341aca9 req-35d913c5-43c1-409b-bb0c-99fe44b8457e tempest-ListServerFiltersTestJSON-1060652857 tempest-ListServerFiltersTestJSON-1060652857-project-member] Enqueued Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 843.513622] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 843.514434] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.514434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.778899] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-759da36a-a18b-4f5f-b889-a6d7444033f4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.779167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.779167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.779521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.779700] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.779700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.779847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.779952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.780059] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.780151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.780297] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-759da36a-a18b-4f5f-b889-a6d7444033f4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.780425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.780506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.780592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.780789] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.780887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.780972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.781099] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.781174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.781286] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.781335] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('759da36a-a18b-4f5f-b889-a6d7444033f4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.158688] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f6add0a9-69ea-4404-b5e7-c33f2c38074f None None] Enqueued Resource ID: eba2d7ff-d257-4201-9a92-97858d7be7a8 with Priority: HIGHEST for action port [ 844.159447] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba2d7ff-d257-4201-9a92-97858d7be7a8 with Priority: HIGHEST for action port [ 844.159856] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-eba2d7ff-d257-4201-9a92-97858d7be7a8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.159975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eba2d7ff-d257-4201-9a92-97858d7be7a8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.161627] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eba2d7ff-d257-4201-9a92-97858d7be7a8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.165869] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eba2d7ff-d257-4201-9a92-97858d7be7a8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.165869] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eba2d7ff-d257-4201-9a92-97858d7be7a8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.238487] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: SUCCESS [ 844.238487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.238707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.238924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.239153] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.239291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.239417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.239526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.239631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.239750] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.283874] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 759da36a-a18b-4f5f-b889-a6d7444033f4: rpc.has_security_group_logging(os_id): False [ 844.300851] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.302345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.302468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.302731] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.302852] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.303188] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.303384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.303419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.303704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.303704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.304512] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.304631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.304752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.304964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.305114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.305792] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.305891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.306038] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.306569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.306772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.307081] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 is going to be created. [ 844.361250] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.361457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.361517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.361712] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.361974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.372491] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 in Status: IN_PROGRESS for 2s [ 844.475594] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-807 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.475594] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-807" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.475594] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-807" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.476106] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-807" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.476186] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.476362] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.476416] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.476635] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.477195] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.477195] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.477195] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.477328] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.477373] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.477496] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.477626] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.477777] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.498533] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.501316] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 844.501316] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.501316] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-807" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.501316] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.501316] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.501316] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.501316] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.501316] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.669423] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eba2d7ff-d257-4201-9a92-97858d7be7a8 [ 844.669423] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.669423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.669423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.669423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.669423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.669423] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eba2d7ff-d257-4201-9a92-97858d7be7a8 already deleted. [ 844.669423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eba2d7ff-d257-4201-9a92-97858d7be7a8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.705539] env[69656]: INFO networking_nsxv3.common.synchronization [None req-b091c322-8280-4733-aaec-3ecfd474573e None None] Enqueued Resource ID: d88b6d4f-976a-4493-8368-4ea32f53fa1b with Priority: HIGHEST for action port [ 844.706614] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88b6d4f-976a-4493-8368-4ea32f53fa1b with Priority: HIGHEST for action port [ 844.707076] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-d88b6d4f-976a-4493-8368-4ea32f53fa1b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.707455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d88b6d4f-976a-4493-8368-4ea32f53fa1b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.707622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d88b6d4f-976a-4493-8368-4ea32f53fa1b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.710513] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d88b6d4f-976a-4493-8368-4ea32f53fa1b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.710513] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d88b6d4f-976a-4493-8368-4ea32f53fa1b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.742697] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.007917] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.008162] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.008297] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.008579] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.008727] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.008887] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d not found, creating... [ 845.009169] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.009318] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.009437] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.009766] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.009857] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.010622] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.010622] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.010622] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.010622] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.011076] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.011076] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d is going to be created. [ 845.038270] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.038270] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.038270] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.038270] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.038270] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.038270] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.213163] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d88b6d4f-976a-4493-8368-4ea32f53fa1b [ 845.213452] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.213708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.213827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.214114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.214212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.214328] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d88b6d4f-976a-4493-8368-4ea32f53fa1b already deleted. [ 845.214441] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d88b6d4f-976a-4493-8368-4ea32f53fa1b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.246449] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.322925] env[69656]: INFO networking_nsxv3.common.synchronization [req-1c3c0a43-1d87-4a71-9f98-866edb41f00f req-8dbba1bd-08dc-4c5e-98be-af0973a51868 tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 845.323193] env[69656]: INFO networking_nsxv3.common.synchronization [req-1c3c0a43-1d87-4a71-9f98-866edb41f00f req-8dbba1bd-08dc-4c5e-98be-af0973a51868 tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c with Priority: HIGHEST for action security_group_members [ 845.323953] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 845.327610] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c with Priority: HIGHEST for action security_group_members [ 845.328029] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.329308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.329308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.329308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.329308] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.329308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.329308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.329308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.329308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.329635] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.334273] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.334273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.334273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.334273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.334273] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.334273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.334273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.334769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.334769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.336554] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0847d0d3-ce87-41d9-8a0b-72fc45464d6c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.385062] env[69656]: INFO networking_nsxv3.common.synchronization [req-1c3c0a43-1d87-4a71-9f98-866edb41f00f req-8dbba1bd-08dc-4c5e-98be-af0973a51868 tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c with Priority: HIGHEST for action security_group_rules [ 845.385311] env[69656]: INFO networking_nsxv3.common.synchronization [req-1c3c0a43-1d87-4a71-9f98-866edb41f00f req-8dbba1bd-08dc-4c5e-98be-af0973a51868 tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c with Priority: HIGHEST for action security_group_members [ 845.385476] env[69656]: INFO networking_nsxv3.common.synchronization [req-1c3c0a43-1d87-4a71-9f98-866edb41f00f req-8dbba1bd-08dc-4c5e-98be-af0973a51868 tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_rules [ 845.385613] env[69656]: INFO networking_nsxv3.common.synchronization [req-1c3c0a43-1d87-4a71-9f98-866edb41f00f req-8dbba1bd-08dc-4c5e-98be-af0973a51868 tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 845.385841] env[69656]: INFO networking_nsxv3.common.synchronization [req-1c3c0a43-1d87-4a71-9f98-866edb41f00f req-8dbba1bd-08dc-4c5e-98be-af0973a51868 tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 09adfda3-4198-41dc-8c46-f9763f2e1b14 with Priority: HIGHEST for action port [ 845.386914] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c with Priority: HIGHEST for action security_group_rules [ 845.387069] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_rules [ 845.387172] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09adfda3-4198-41dc-8c46-f9763f2e1b14 with Priority: HIGHEST for action port [ 845.387267] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c with Priority: HIGHEST for action security_group_members [ 845.387373] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 845.387676] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0847d0d3-ce87-41d9-8a0b-72fc45464d6c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.387817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.387891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.388199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.388284] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0847d0d3-ce87-41d9-8a0b-72fc45464d6c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.389471] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.389558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.389686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.390284] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.390412] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.391602] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-09adfda3-4198-41dc-8c46-f9763f2e1b14 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.391721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.391790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.392102] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.392193] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09adfda3-4198-41dc-8c46-f9763f2e1b14',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.393380] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.393500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.393673] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.393816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.753134] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.753134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.753134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.753134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.753134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.753134] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d is going to be updated. [ 845.782140] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.782140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.782140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.782140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.782140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.789927] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: IN_PROGRESS for 2s [ 845.831405] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.842511] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0847d0d3-ce87-41d9-8a0b-72fc45464d6c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.895248] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09adfda3-4198-41dc-8c46-f9763f2e1b14 with status ACTIVE [ 845.895376] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.895502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.895573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.895804] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.895899] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.896093] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.896311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.896311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.896414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.896495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.896674] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.896767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.896827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.896966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.897053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.897137] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09adfda3-4198-41dc-8c46-f9763f2e1b14 is going to be updated. [ 845.898620] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.898714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.898936] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.899032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.920074] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.920229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.920282] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.920496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.920630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.920800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.039132] env[69656]: INFO networking_nsxv3.common.synchronization [req-54418b40-4517-458a-b0cb-96579341aca9 req-bfa984cf-2c11-4065-8f68-7feab58dd659 service nova] Enqueued Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_rules [ 846.039206] env[69656]: INFO networking_nsxv3.common.synchronization [req-54418b40-4517-458a-b0cb-96579341aca9 req-bfa984cf-2c11-4065-8f68-7feab58dd659 service nova] Enqueued Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 846.039376] env[69656]: INFO networking_nsxv3.common.synchronization [req-54418b40-4517-458a-b0cb-96579341aca9 req-bfa984cf-2c11-4065-8f68-7feab58dd659 service nova] Enqueued Resource ID: 1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d with Priority: HIGHEST for action port [ 846.039526] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_rules [ 846.039697] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 846.039786] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d with Priority: HIGHEST for action port [ 846.041065] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.044179] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.044470] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.044587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.044920] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.044920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.045052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.045282] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.045384] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.338579] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.346034] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0847d0d3-ce87-41d9-8a0b-72fc45464d6c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.384314] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 in Status: SUCCESS [ 846.384431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.490022] env[69656]: INFO networking_nsxv3.common.synchronization [req-408db69f-e077-4028-80e1-0989b663daa2 req-ccf1eb4e-61f5-4e8a-b611-6e7854b49feb tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 846.490022] env[69656]: INFO networking_nsxv3.common.synchronization [req-408db69f-e077-4028-80e1-0989b663daa2 req-ccf1eb4e-61f5-4e8a-b611-6e7854b49feb tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c with Priority: HIGHEST for action security_group_members [ 846.490022] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 846.490022] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c with Priority: HIGHEST for action security_group_members [ 846.490022] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.490022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.496859] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.496859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.541044] env[69656]: INFO networking_nsxv3.common.synchronization [req-408db69f-e077-4028-80e1-0989b663daa2 req-ccf1eb4e-61f5-4e8a-b611-6e7854b49feb tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_rules [ 846.541044] env[69656]: INFO networking_nsxv3.common.synchronization [req-408db69f-e077-4028-80e1-0989b663daa2 req-ccf1eb4e-61f5-4e8a-b611-6e7854b49feb tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 846.541044] env[69656]: INFO networking_nsxv3.common.synchronization [req-408db69f-e077-4028-80e1-0989b663daa2 req-ccf1eb4e-61f5-4e8a-b611-6e7854b49feb tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 09adfda3-4198-41dc-8c46-f9763f2e1b14 with Priority: HIGHEST for action port [ 846.541044] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_rules [ 846.541044] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 846.541044] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09adfda3-4198-41dc-8c46-f9763f2e1b14 with Priority: HIGHEST for action port [ 846.541044] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.541044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.541639] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.541639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.541639] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-09adfda3-4198-41dc-8c46-f9763f2e1b14 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.541639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.541639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.542069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.542069] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09adfda3-4198-41dc-8c46-f9763f2e1b14',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.550093] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d with status ACTIVE [ 846.550309] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.551364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.551364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.551364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.551364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.551364] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.551364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.551364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.551823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.551823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.551823] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.551823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.551823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.552132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.552132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.552132] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d is going to be updated. [ 846.578794] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.578794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.578794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.578794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.578794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.578794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f2ca81b-f6b1-4b8f-9be7-4c6c90e4307d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.696423] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.696628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.696687] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.697025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.697172] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.758374] env[69656]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 846.758374] env[69656]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] NSXv3 Agent Agent loop - iteration:1 started [ 846.841194] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.844246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.844246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.844246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.844246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.844246] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 is going to be updated. [ 846.851952] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.851952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.851952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.851952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.851952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.851952] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c is going to be created. [ 846.868960] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.870076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.870076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.870584] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.872019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.873992] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.876018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.876018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.876018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.876018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.885259] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: IN_PROGRESS for 2s [ 846.886738] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c in Status: UNINITIALIZED for 2s [ 847.044033] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09adfda3-4198-41dc-8c46-f9763f2e1b14 with status ACTIVE [ 847.044321] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.044481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.044568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.044734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.044866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.045192] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.045192] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.045369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.045419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.045604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.045842] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.046040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.046040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.046448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.046448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.046448] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09adfda3-4198-41dc-8c46-f9763f2e1b14 is going to be updated. [ 847.072084] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.072084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.072084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.072084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.072084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.072084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09adfda3-4198-41dc-8c46-f9763f2e1b14" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.203163] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.417543] env[69656]: INFO networking_nsxv3.common.synchronization [req-2ae56252-a43e-4c97-bf57-228a0e5b2c7b req-e86eea2c-02a0-461c-980e-b30c65ddc16f tempest-ServerMetadataNegativeTestJSON-1464603032 tempest-ServerMetadataNegativeTestJSON-1464603032-project-member] Enqueued Resource ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 with Priority: HIGHEST for action security_group_members [ 847.419565] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 with Priority: HIGHEST for action security_group_members [ 847.424258] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-73af530a-6b5a-405c-a77e-a32b8c5ebc26 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.424258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.424258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.424258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.424258] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.424258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.424258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.424258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.424258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.424258] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73af530a-6b5a-405c-a77e-a32b8c5ebc26',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.697211] env[69656]: INFO networking_nsxv3.common.synchronization [None req-5ff3bd4b-4e31-4ef7-bec3-b56562725a2c None None] Enqueued Resource ID: 3d8400c3-ca40-44ff-9ebd-a20c4f009673 with Priority: HIGHEST for action port [ 847.697650] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8400c3-ca40-44ff-9ebd-a20c4f009673 with Priority: HIGHEST for action port [ 847.698436] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d8400c3-ca40-44ff-9ebd-a20c4f009673 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.698630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d8400c3-ca40-44ff-9ebd-a20c4f009673" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.698630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d8400c3-ca40-44ff-9ebd-a20c4f009673" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.700810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d8400c3-ca40-44ff-9ebd-a20c4f009673" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.700810] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d8400c3-ca40-44ff-9ebd-a20c4f009673',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.706090] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.804172] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: SUCCESS [ 847.804172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.804172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.804172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.804172] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.804172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.804172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.804172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.804172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.805120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.805546] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.808397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.808397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.808397] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.808397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.810025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.810025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.810025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.810025] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.926055] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.926055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.926055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.926055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.926055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.927440] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.927722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.930034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.930034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.930034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.930034] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 is going to be updated. [ 847.959491] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.959491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.959491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.959491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.959491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.966673] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 in Status: IN_PROGRESS for 2s [ 848.203037] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d8400c3-ca40-44ff-9ebd-a20c4f009673 [ 848.203273] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.203441] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.203505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.203777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.203854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.203955] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d8400c3-ca40-44ff-9ebd-a20c4f009673 already deleted. [ 848.204105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d8400c3-ca40-44ff-9ebd-a20c4f009673" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.211608] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 848.211608] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 848.313884] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.313884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.313995] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.818314] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.905347] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c in Status: SUCCESS [ 848.905711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.906838] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: SUCCESS [ 848.907085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.907717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.908148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.908281] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.908474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.908582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.908853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.908905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.909031] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0847d0d3-ce87-41d9-8a0b-72fc45464d6c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.910098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.910373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.911268] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.911268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.911268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.911268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.911268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.911268] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.965647] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.965841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.965911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.966128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.981589] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 848.982543] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.984022] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 849.011337] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.011337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.011337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.011337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.016467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.017036] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 849.017133] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 849.017197] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 849.049226] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.049398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.049447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.049647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.051722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.051905] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 849.111964] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.112274] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.112399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.113049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.113238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.113522] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 849.169985] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.169985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.170614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.170614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.170614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.171018] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 849.174790] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'53bb734e-5b1e-47d3-a1af-56162bde2894', '753a0574-7bcf-4133-85db-b811b57f750a', '97579684-a77f-4bf3-9586-742120a2eca4', '0ed397b9-8a6a-442e-a200-45439f9f86d9', '45271c60-03cb-4886-a9a6-d3916a12e9bc', '22763ac9-09b1-45ba-b8a9-6df4fc54e141', 'a33f9cc8-ecf3-4437-910b-83546eec0eb5', '6c789852-e0f1-466f-87e6-4a1aee8710c0', 'eb99eac5-5acc-4d01-82c2-7167ff647d1f', 'f6051e2d-23c6-4a8c-a86d-4ef24733ee00', '39d79c92-ce40-4ea6-bf34-2e0fcc875300', 'fcdf0196-2f66-4c44-9bd4-b05de185002c', 'c9050284-73b2-4fa6-becd-7f21223f038d', '042dbbad-7370-4640-8e5b-325f400f2cd1', 'c36721c6-8615-4066-ad71-7555325052c1', '73af530a-6b5a-405c-a77e-a32b8c5ebc26', '31cf519f-28de-486a-adaf-2d0102b1bc5b', 'e79ef0da-74c8-48fe-99d7-25b720dd4847', 'b629ee2e-0b52-4f1a-9ab3-28190008dec5', '7231807f-8442-4d3b-854a-2fa3a40877dd', '5f636061-691e-4a7a-a595-1723a2745695', '7cc9edd3-ec13-4776-b83d-312440c75c07', 'e5c76201-04fa-4fa1-bd82-b1756116b4c4', 'cbab9cac-0394-407c-b39a-2ca9394c8a11', '759da36a-a18b-4f5f-b889-a6d7444033f4', '6d9740de-f67c-4fbd-a249-44afc4caaef1', 'e7c27843-e365-4bd4-9103-dc94b0c2a637', '792b043f-2560-4918-890f-99f50b059db4', '037b783b-a9e4-4669-8461-2452a42615e1', '3a714e7c-1123-47f3-81e4-70f097603f3e', '8e938057-3189-4358-8ca5-5e18d05bbddf', '4a133f47-cf05-42f1-8365-6a566b72e14d', 'f3521005-0bf3-4791-8930-fe6bb6c94423', '8a9ee1b5-46c4-4ea5-a724-f697a2014dcb'} {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 849.174790] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 849.188274] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.188418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.188491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.191181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.191291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.191415] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 849.191492] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 849.191566] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 849.255227] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.255227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.255441] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.256925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.256925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.257143] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 849.257223] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 849.257415] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 849.257577] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 849.257690] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/34 resources of Type:Security Group Rules [ 849.257772] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGH for action security_group_rules [ 849.257850] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 753a0574-7bcf-4133-85db-b811b57f750a with Priority: HIGH for action security_group_rules [ 849.257913] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGH for action security_group_rules [ 849.258047] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGH for action security_group_rules [ 849.258129] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc with Priority: HIGH for action security_group_rules [ 849.258179] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGH for action security_group_rules [ 849.258256] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGH for action security_group_rules [ 849.258318] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 with Priority: HIGH for action security_group_rules [ 849.258377] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGH for action security_group_rules [ 849.258436] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGH for action security_group_rules [ 849.258494] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGH for action security_group_rules [ 849.258550] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGH for action security_group_rules [ 849.258610] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c9050284-73b2-4fa6-becd-7f21223f038d with Priority: HIGH for action security_group_rules [ 849.258667] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 with Priority: HIGH for action security_group_rules [ 849.258725] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c36721c6-8615-4066-ad71-7555325052c1 with Priority: HIGH for action security_group_rules [ 849.258792] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 with Priority: HIGH for action security_group_rules [ 849.258852] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b with Priority: HIGH for action security_group_rules [ 849.258909] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGH for action security_group_rules [ 849.258953] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGH for action security_group_rules [ 849.259012] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7231807f-8442-4d3b-854a-2fa3a40877dd with Priority: HIGH for action security_group_rules [ 849.259128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.321042] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.322201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.322201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.322201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.322201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.322201] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d is going to be updated. [ 849.348673] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.349490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.351253] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.352412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.352412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.361755] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: IN_PROGRESS for 2s [ 849.414378] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.414378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.414378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.414378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.414378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.414378] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.414766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.414766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.414766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.414894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.414894] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c is going to be deleted. [ 849.417101] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.446067] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.446262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.446318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.446654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.446839] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.446961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.447472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.447472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.447702] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.447844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.447948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.449068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.449138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.449253] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0847d0d3-ce87-41d9-8a0b-72fc45464d6c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.921735] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.952683] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.952941] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.953096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.953343] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.953476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.953736] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.953893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.953989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.954199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.954300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.954403] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c already deleted. [ 849.954474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.954587] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0847d0d3-ce87-41d9-8a0b-72fc45464d6c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.956724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.956724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.956724] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.956724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.956724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.956724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.956724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.956724] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0847d0d3-ce87-41d9-8a0b-72fc45464d6c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.977543] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 in Status: SUCCESS [ 849.977543] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 deletion is rescheduled due to dependency. [ 849.977543] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.428228] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.428228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.428228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.428228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.428228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.428228] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 is going to be updated. [ 850.458330] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0847d0d3-ce87-41d9-8a0b-72fc45464d6c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.459456] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.460093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.460093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.460309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.460309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.460595] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.460730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.460798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.460975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.461120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.461285] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c already deleted. [ 850.461285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.462502] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.462608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.462711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.462884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.463042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.474143] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: IN_PROGRESS for 2s [ 850.508067] env[69656]: INFO networking_nsxv3.common.synchronization [req-427c2976-2937-455c-9fd0-7dc4a5e7a80c req-92d855a7-a4a6-4f93-8a6b-27e4443e3f78 tempest-ServersTestBootFromVolume-403368592 tempest-ServersTestBootFromVolume-403368592-project-member] Enqueued Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGHEST for action security_group_members [ 850.508698] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGHEST for action security_group_members [ 850.508864] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97579684-a77f-4bf3-9586-742120a2eca4 with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c36721c6-8615-4066-ad71-7555325052c1 with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7231807f-8442-4d3b-854a-2fa3a40877dd with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9050284-73b2-4fa6-becd-7f21223f038d with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGH for action security_group_rules [ 850.512130] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 with Priority: HIGH for action security_group_rules [ 850.512844] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc with Priority: HIGH for action security_group_rules [ 850.512844] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 753a0574-7bcf-4133-85db-b811b57f750a with Priority: HIGH for action security_group_rules [ 850.512844] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGH for action security_group_rules [ 850.512844] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-53bb734e-5b1e-47d3-a1af-56162bde2894 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.513068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.513068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.513337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.513577] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.513660] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.513710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.513908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.513963] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.514272] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53bb734e-5b1e-47d3-a1af-56162bde2894',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.515098] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53bb734e-5b1e-47d3-a1af-56162bde2894 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.515229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.515295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.516193] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.516353] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53bb734e-5b1e-47d3-a1af-56162bde2894',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.518388] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97579684-a77f-4bf3-9586-742120a2eca4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.518388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.518388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.518388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.518388] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97579684-a77f-4bf3-9586-742120a2eca4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.520359] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.520359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.520491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.520613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.521279] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.526323] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c36721c6-8615-4066-ad71-7555325052c1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.526472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.526555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.526749] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.526845] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c36721c6-8615-4066-ad71-7555325052c1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.528160] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7231807f-8442-4d3b-854a-2fa3a40877dd taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.528281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.528358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.528985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.528985] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7231807f-8442-4d3b-854a-2fa3a40877dd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.530208] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.530208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.530208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.530208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.530494] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.531972] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e79ef0da-74c8-48fe-99d7-25b720dd4847 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.532103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.532186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.532359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.532415] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.535168] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31cf519f-28de-486a-adaf-2d0102b1bc5b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.535168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.535436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.535436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.535540] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31cf519f-28de-486a-adaf-2d0102b1bc5b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.537387] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-042dbbad-7370-4640-8e5b-325f400f2cd1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.537387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.537387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.537387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.537593] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('042dbbad-7370-4640-8e5b-325f400f2cd1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.537711] env[69656]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 850.539204] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73af530a-6b5a-405c-a77e-a32b8c5ebc26 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.539365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.539365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.539536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.539593] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73af530a-6b5a-405c-a77e-a32b8c5ebc26',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.540485] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9050284-73b2-4fa6-becd-7f21223f038d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.540610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.540680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.540799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.541917] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9050284-73b2-4fa6-becd-7f21223f038d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.541917] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.541917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.541917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.542261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.542261] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.543047] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.543151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.543343] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.543487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.543487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.543644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.543715] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6051e2d-23c6-4a8c-a86d-4ef24733ee00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.545923] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.545923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.545923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.545923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.545923] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.546869] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.546977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.547053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.547200] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.547276] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.550577] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c789852-e0f1-466f-87e6-4a1aee8710c0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.550687] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.551718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.551718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.551718] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c789852-e0f1-466f-87e6-4a1aee8710c0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.551986] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45271c60-03cb-4886-a9a6-d3916a12e9bc taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.552174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.552262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.552455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.552532] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45271c60-03cb-4886-a9a6-d3916a12e9bc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.553724] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-753a0574-7bcf-4133-85db-b811b57f750a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.553895] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.553895] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.554078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.554078] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.555743] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.555743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.555743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.555743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.555743] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.555743] env[69656]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 850.963095] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0847d0d3-ce87-41d9-8a0b-72fc45464d6c: rpc.has_security_group_logging(os_id): False [ 850.996976] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.996976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.996976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.996976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.996976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.996976] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.996976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.996976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.996976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.996976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.996976] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c is going to be created. [ 851.018660] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0847d0d3-ce87-41d9-8a0b-72fc45464d6c], does not exist path=[/infra/domains/default/groups/0847d0d3-ce87-41d9-8a0b-72fc45464d6c]."\n}' [ 851.018660] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0847d0d3-ce87-41d9-8a0b-72fc45464d6c [ 851.018660] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 851.054036] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.054236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.054278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.054465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.055209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.055462] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.055582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.055658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.055790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.055971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.056474] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.056474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.056474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.056474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.056474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.056696] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0847d0d3-ce87-41d9-8a0b-72fc45464d6c is going to be created. [ 851.062753] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.062914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.062952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.064442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.083815] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0847d0d3-ce87-41d9-8a0b-72fc45464d6c], does not exist path=[/infra/domains/default/groups/0847d0d3-ce87-41d9-8a0b-72fc45464d6c]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0847d0d3-ce87-41d9-8a0b-72fc45464d6c [ 851.084062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0847d0d3-ce87-41d9-8a0b-72fc45464d6c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.084545] env[69656]: Traceback (most recent call last): [ 851.084654] env[69656]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 851.084654] env[69656]: return func(*args, **kwargs) [ 851.084654] env[69656]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 851.084654] env[69656]: res.raise_for_status() [ 851.084654] env[69656]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 851.084654] env[69656]: raise HTTPError(http_error_msg, response=self) [ 851.084654] env[69656]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0847d0d3-ce87-41d9-8a0b-72fc45464d6c [ 851.084654] env[69656]: During handling of the above exception, another exception occurred: [ 851.084654] env[69656]: Traceback (most recent call last): [ 851.084654] env[69656]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 851.084654] env[69656]: listener.cb(fileno) [ 851.084654] env[69656]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 851.084654] env[69656]: result = function(*args, **kwargs) [ 851.084654] env[69656]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 851.084654] env[69656]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 851.084654] env[69656]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 851.084654] env[69656]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 851.084654] env[69656]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 851.084654] env[69656]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 851.084654] env[69656]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 851.084654] env[69656]: res.raise_for_status() [ 851.084654] env[69656]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 851.084654] env[69656]: raise HTTPError(http_error_msg, response=self) [ 851.084654] env[69656]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0847d0d3-ce87-41d9-8a0b-72fc45464d6c [ 851.084654] env[69656]: Removing descriptor: 5 [ 851.089901] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.090070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.091181] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.091181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.094100] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.094220] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.094309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.095665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.095665] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.095665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.095665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.095665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.095665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.095665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.095665] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.097594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.097854] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.099312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.099312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.099312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.099312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.099312] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 is going to be updated. [ 851.100086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.100272] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.101301] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.101418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.101496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.101638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.101858] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.101968] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.102051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.102359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.102844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.102973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.103219] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.109378] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e79ef0da-74c8-48fe-99d7-25b720dd4847 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.109378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.109378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.109378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.109378] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.109378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.109903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.109903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.109903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.109903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.109903] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.120340] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.120340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.120340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.120340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.120340] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.120635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.120635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.120729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.120821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.120920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.121562] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.122067] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb99eac5-5acc-4d01-82c2-7167ff647d1f taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.122303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.122303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.122407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.122553] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.122658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.122717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.123021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.123124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.123241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.123342] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.129021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-753a0574-7bcf-4133-85db-b811b57f750a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.129021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.129021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.129021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.129021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.129021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.129021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.129021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.129021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.129021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.129021] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.130012] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a33f9cc8-ecf3-4437-910b-83546eec0eb5 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.130124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.130183] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.130341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.130487] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.130575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.130633] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.130769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.130866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.130952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.131055] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.141209] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.141336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.145369] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.146546] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.153980] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.154150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.214324] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.214639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.214639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.214859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.215026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.218232] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.218232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.218862] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.218976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.219770] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.219878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.220748] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.220842] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.221665] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.221771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.222480] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.222621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.223285] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.223369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.224088] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.224269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.225192] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 851.225709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.225827] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97579684-a77f-4bf3-9586-742120a2eca4 is going to be deleted. [ 851.226818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.227057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.227166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.227270] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 is going to be deleted. [ 851.228249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.228451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.232997] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 in Status: IN_PROGRESS for 2s [ 851.260906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.260906] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7231807f-8442-4d3b-854a-2fa3a40877dd is going to be deleted. [ 851.261463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.261703] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.280880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.281085] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73af530a-6b5a-405c-a77e-a32b8c5ebc26 is going to be deleted. [ 851.282021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.282245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.305137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.305137] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9050284-73b2-4fa6-becd-7f21223f038d is going to be deleted. [ 851.305902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.305902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.310035] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.310035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.328912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.329209] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be deleted. [ 851.330500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.330815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.333843] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.333843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.366632] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.366860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.374337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.374337] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c36721c6-8615-4066-ad71-7555325052c1 is going to be deleted. [ 851.374757] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.374987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.379703] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: SUCCESS [ 851.379970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.380149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.380370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.380563] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.380679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.380809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.380910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.380995] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.381105] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.405581] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.405694] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.407966] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.408146] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.427397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.427397] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6051e2d-23c6-4a8c-a86d-4ef24733ee00 is going to be deleted. [ 851.428324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.428544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.464190] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.464459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.485183] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.485344] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 042dbbad-7370-4640-8e5b-325f400f2cd1 is going to be deleted. [ 851.486418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.486650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.537249] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.537401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.540142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.540273] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31cf519f-28de-486a-adaf-2d0102b1bc5b is going to be deleted. [ 851.541891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.541891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.562117] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.562307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.575140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.575285] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c789852-e0f1-466f-87e6-4a1aee8710c0 is going to be deleted. [ 851.576481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.576481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.594987] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.595214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.609436] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.617167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.617328] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45271c60-03cb-4886-a9a6-d3916a12e9bc is going to be deleted. [ 851.618395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.618606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.618710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.618841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.619011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.619225] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.619626] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.619626] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97579684-a77f-4bf3-9586-742120a2eca4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.620666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.620854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.620942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.621095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7231807f-8442-4d3b-854a-2fa3a40877dd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.621257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.621421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.621503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.621615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73af530a-6b5a-405c-a77e-a32b8c5ebc26" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.622138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.622347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.622925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.622925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9050284-73b2-4fa6-becd-7f21223f038d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.622925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.622925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.622925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.623170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.623170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.623462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.623462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.623540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c36721c6-8615-4066-ad71-7555325052c1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.623614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.623755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.623831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.623953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6051e2d-23c6-4a8c-a86d-4ef24733ee00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.624091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.624250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.624325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.624451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-042dbbad-7370-4640-8e5b-325f400f2cd1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.630410] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.639359] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.639519] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.639565] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.639899] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.640084] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.640186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.640251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.640428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.640515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.640617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.640768] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.640892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.640956] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.641148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.641288] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.641393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.641453] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.641590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.641684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.641800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.642031] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.642978] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.647020] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.648071] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e79ef0da-74c8-48fe-99d7-25b720dd4847: rpc.has_security_group_logging(os_id): False [ 851.653301] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb99eac5-5acc-4d01-82c2-7167ff647d1f: rpc.has_security_group_logging(os_id): False [ 851.662864] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.662864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.662864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.662864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.662864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.663140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31cf519f-28de-486a-adaf-2d0102b1bc5b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.670187] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.670321] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.670389] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.670585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.672306] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.672424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.676424] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.676535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.702495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.702809] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.702902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.702975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.703207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.703293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.703389] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 is going to be updated. [ 851.704573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.704759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.704836] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.704963] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c789852-e0f1-466f-87e6-4a1aee8710c0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.705118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.705292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.757789] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.757910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.762739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.763053] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.763157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.763223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.763417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.763501] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.763589] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f is going to be updated. [ 851.764878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.765074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.765173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.765345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45271c60-03cb-4886-a9a6-d3916a12e9bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.831700] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.831848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.831918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.832141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.832289] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.874904] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 in Status: IN_PROGRESS for 2s [ 851.885745] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.912235] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 851.912704] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.912908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.913045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.913417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.913488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.952791] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f in Status: IN_PROGRESS for 2s [ 852.112328] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ed397b9-8a6a-442e-a200-45439f9f86d9: rpc.has_security_group_logging(os_id): False [ 852.131061] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.131061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.131061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.131271] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.133915] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 753a0574-7bcf-4133-85db-b811b57f750a: rpc.has_security_group_logging(os_id): False [ 852.145359] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22763ac9-09b1-45ba-b8a9-6df4fc54e141: rpc.has_security_group_logging(os_id): False [ 852.148487] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b629ee2e-0b52-4f1a-9ab3-28190008dec5: rpc.has_security_group_logging(os_id): False [ 852.149577] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a33f9cc8-ecf3-4437-910b-83546eec0eb5: rpc.has_security_group_logging(os_id): False [ 852.173869] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.173994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.174812] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.175122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.179486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.180359] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.180359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.180359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.180359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.180359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.180585] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be updated. [ 852.181486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.181681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.183169] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.183298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.185158] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.185257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.226969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.227340] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.227452] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.227535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.227743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.227828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.227924] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 753a0574-7bcf-4133-85db-b811b57f750a is going to be updated. [ 852.229240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.229470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.257824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.258127] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.258276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.258347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.258562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.258640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.258866] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.258972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.259046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.259224] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.259301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.259490] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.259570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.259643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.259813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.259898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.260012] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 852.261767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.261767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.281524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.281524] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.281524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.281524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.281799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.281799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.281799] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 is going to be updated. [ 852.282906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.283279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.296592] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.296732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.297826] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.297898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.308437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.308855] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.308855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.308985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.309139] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.309228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.309343] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 is going to be updated. [ 852.310475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.313101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.313101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.313101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.313101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.313101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.341432] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 753a0574-7bcf-4133-85db-b811b57f750a in Status: IN_PROGRESS for 2s [ 852.342286] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: IN_PROGRESS for 2s [ 852.387695] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.459371] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.459552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.459628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.459881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.460054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.467575] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.467843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.467843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.467981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.468142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.471926] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.471926] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.472147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.472326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.472527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.502595] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: SUCCESS [ 852.502845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.503042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.503312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.503523] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.503643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.503720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.503873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.503966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.504078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.504203] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.506354] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 in Status: IN_PROGRESS for 2s [ 852.506735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.507591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.507591] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.507591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.507591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.507858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.507972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.508113] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.510033] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 852.510992] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: IN_PROGRESS for 2s [ 852.704524] env[69656]: INFO networking_nsxv3.common.synchronization [req-675064bc-e308-4782-b24a-a40f088cfbac req-e6706844-2520-43f7-b384-253ea309c340 tempest-ServerGroupTestJSON-1584243530 tempest-ServerGroupTestJSON-1584243530-project-member] Enqueued Resource ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 with Priority: HIGHEST for action security_group_members [ 852.704524] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 with Priority: HIGHEST for action security_group_members [ 852.704524] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-759da36a-a18b-4f5f-b889-a6d7444033f4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.704524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.704524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.705610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.706015] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.706290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.706443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.706835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.708465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.708465] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('759da36a-a18b-4f5f-b889-a6d7444033f4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.892482] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.892482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.892482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.892482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.892482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.892482] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d is going to be updated. [ 852.936987] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.937183] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.937287] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.938063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.938302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.952605] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: IN_PROGRESS for 2s [ 853.010385] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.014171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.014757] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.024053] env[69656]: INFO networking_nsxv3.common.synchronization [req-cd7c47cb-cf21-4ad7-bb86-622eee083c2b req-31fd6032-70fb-4315-a169-b62004878f7b tempest-ServersAdminTestJSON-1828746712 tempest-ServersAdminTestJSON-1828746712-project-member] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 853.024524] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 853.024828] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.025022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.025640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.025867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.026114] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.026233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.026296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.026469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.028119] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.028119] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.210554] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.210554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.210554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.210954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.233477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.233795] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.233999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.234104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.234329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.234418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.234561] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 is going to be updated. [ 853.246092] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 in Status: SUCCESS [ 853.246317] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53bb734e-5b1e-47d3-a1af-56162bde2894 deletion is rescheduled due to dependency. [ 853.246429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53bb734e-5b1e-47d3-a1af-56162bde2894" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.261126] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.261283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.261373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.261605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.262476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.273802] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 in Status: IN_PROGRESS for 2s [ 853.519932] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.530373] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.885203] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.885203] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.885203] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.885203] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.885203] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.885203] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.885630] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.886018] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.889019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.889019] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.889019] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.889019] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.889019] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.889019] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.889019] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.889019] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.890603] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 in Status: SUCCESS [ 853.890984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.906652] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.909282] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 853.909282] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.909282] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.912061] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-734f159d-8e0f-42a9-9f6f-cb52f8a583cf taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.912061] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-734f159d-8e0f-42a9-9f6f-cb52f8a583cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.912061] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-734f159d-8e0f-42a9-9f6f-cb52f8a583cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.912061] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-734f159d-8e0f-42a9-9f6f-cb52f8a583cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.912061] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('734f159d-8e0f-42a9-9f6f-cb52f8a583cf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.966173] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f in Status: SUCCESS [ 853.966173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.022713] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.023880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.023880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.023880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.023880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.023880] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 is going to be updated. [ 854.035021] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.053917] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.054141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.054227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.054420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.054565] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.063816] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: IN_PROGRESS for 2s [ 854.108150] env[69656]: INFO networking_nsxv3.common.synchronization [None req-9dc01771-c93e-4207-ae7c-6cbc44d2c08a None None] Enqueued Resource ID: eb541249-3926-4d84-93b4-7b315f18df45 with Priority: HIGHEST for action port [ 854.108768] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb541249-3926-4d84-93b4-7b315f18df45 with Priority: HIGHEST for action port [ 854.109080] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb541249-3926-4d84-93b4-7b315f18df45 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.109209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb541249-3926-4d84-93b4-7b315f18df45" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.109278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb541249-3926-4d84-93b4-7b315f18df45" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.109531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb541249-3926-4d84-93b4-7b315f18df45" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.109614] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb541249-3926-4d84-93b4-7b315f18df45',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.357627] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 753a0574-7bcf-4133-85db-b811b57f750a in Status: SUCCESS [ 854.357627] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.357627] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: SUCCESS [ 854.357627] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.418056] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.418056] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.418056] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.418056] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.418056] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.418056] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 734f159d-8e0f-42a9-9f6f-cb52f8a583cf not found, creating... [ 854.418056] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.418056] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.418056] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.418056] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.418056] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.418526] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.418526] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.418526] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.418904] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.419221] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.419547] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 734f159d-8e0f-42a9-9f6f-cb52f8a583cf is going to be created. [ 854.440082] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.440082] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.440082] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.440082] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.440082] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.440082] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-734f159d-8e0f-42a9-9f6f-cb52f8a583cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.521440] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 in Status: SUCCESS [ 854.521812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.523332] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: SUCCESS [ 854.523742] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.525311] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 854.525701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.538505] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.538752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.538834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.539166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.539166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.539270] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be updated. [ 854.582860] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.583058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.583150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.583382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.583551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.604607] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 854.612815] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb541249-3926-4d84-93b4-7b315f18df45 [ 854.613108] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.613295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.613373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.613586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.613677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.613774] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb541249-3926-4d84-93b4-7b315f18df45 already deleted. [ 854.613860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb541249-3926-4d84-93b4-7b315f18df45" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.962755] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: SUCCESS [ 854.962755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.962899] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.963084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.963270] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.963462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.963554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.964541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.964541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.964541] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.126715] env[69656]: INFO networking_nsxv3.common.synchronization [req-6f3de46b-3d3f-4aad-8d54-6b1f5783de7d req-62bb2452-c75d-4d1b-9c5d-4c10d8c7847c tempest-SecurityGroupRulesTestJSON-564151331 tempest-SecurityGroupRulesTestJSON-564151331-project-member] Enqueued Resource ID: 24191d48-9d19-426d-a683-b85e9eaa40d9 with Priority: HIGHEST for action security_group_rules [ 855.127189] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24191d48-9d19-426d-a683-b85e9eaa40d9 with Priority: HIGHEST for action security_group_rules [ 855.128136] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24191d48-9d19-426d-a683-b85e9eaa40d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.128424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24191d48-9d19-426d-a683-b85e9eaa40d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.128734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24191d48-9d19-426d-a683-b85e9eaa40d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.129077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24191d48-9d19-426d-a683-b85e9eaa40d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.129312] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24191d48-9d19-426d-a683-b85e9eaa40d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.283967] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 in Status: SUCCESS [ 855.284189] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 deletion is rescheduled due to dependency. [ 855.284322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.466743] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.548137] env[69656]: INFO networking_nsxv3.common.synchronization [req-cd7c47cb-cf21-4ad7-bb86-622eee083c2b req-8c5f79ad-6f80-49a6-bec2-eda13e7462fe service nova] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_rules [ 855.548637] env[69656]: INFO networking_nsxv3.common.synchronization [req-cd7c47cb-cf21-4ad7-bb86-622eee083c2b req-8c5f79ad-6f80-49a6-bec2-eda13e7462fe service nova] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 855.548864] env[69656]: INFO networking_nsxv3.common.synchronization [req-cd7c47cb-cf21-4ad7-bb86-622eee083c2b req-8c5f79ad-6f80-49a6-bec2-eda13e7462fe service nova] Enqueued Resource ID: 734f159d-8e0f-42a9-9f6f-cb52f8a583cf with Priority: HIGHEST for action port [ 855.549173] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_rules [ 855.549364] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 855.549690] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734f159d-8e0f-42a9-9f6f-cb52f8a583cf with Priority: HIGHEST for action port [ 855.550369] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.550556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.550646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.550889] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.551032] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.557250] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.557377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.557616] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-734f159d-8e0f-42a9-9f6f-cb52f8a583cf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.557735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-734f159d-8e0f-42a9-9f6f-cb52f8a583cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.557802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-734f159d-8e0f-42a9-9f6f-cb52f8a583cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.558011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-734f159d-8e0f-42a9-9f6f-cb52f8a583cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.558097] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('734f159d-8e0f-42a9-9f6f-cb52f8a583cf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.649079] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.652930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.652930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.652930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.652930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.652930] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24191d48-9d19-426d-a683-b85e9eaa40d9 already deleted. [ 855.652930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24191d48-9d19-426d-a683-b85e9eaa40d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.841325] env[69656]: INFO networking_nsxv3.common.synchronization [req-da82dadf-12f8-4dc5-adf3-45031496acee req-71c02d3e-184c-4d77-8476-3303f5337b33 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 855.841325] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 855.841325] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.841325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.841325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.841325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.841325] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.841325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.841626] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.841626] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.841626] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.841715] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.969528] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.060008] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.060160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.060352] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 734f159d-8e0f-42a9-9f6f-cb52f8a583cf with status ACTIVE [ 856.060586] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.060700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.060772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.061049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.061123] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.061251] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.061343] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.061403] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.061558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.061633] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.061810] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.061913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.061972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.062277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.062277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.062277] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 734f159d-8e0f-42a9-9f6f-cb52f8a583cf is going to be updated. [ 856.074818] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: SUCCESS [ 856.075180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.075385] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.075607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.075796] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.075936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.076522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.076522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.076522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.076522] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.083192] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.083360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.083360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.083552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.084292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.084292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-734f159d-8e0f-42a9-9f6f-cb52f8a583cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.345363] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.422704] env[69656]: INFO networking_nsxv3.common.synchronization [None req-4def44b1-6429-4185-a391-42612b71a521 None None] Enqueued Resource ID: bda66134-74f2-4072-ae41-71132cfa9b91 with Priority: HIGHEST for action port [ 856.423471] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bda66134-74f2-4072-ae41-71132cfa9b91 with Priority: HIGHEST for action port [ 856.423908] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-bda66134-74f2-4072-ae41-71132cfa9b91 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.424120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bda66134-74f2-4072-ae41-71132cfa9b91" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.424270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bda66134-74f2-4072-ae41-71132cfa9b91" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.424566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bda66134-74f2-4072-ae41-71132cfa9b91" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.424624] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bda66134-74f2-4072-ae41-71132cfa9b91',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.477014] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.477014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.477014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.477014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.477014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.477014] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d is going to be updated. [ 856.504213] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.504213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.504213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.504213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.504213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.513761] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: IN_PROGRESS for 2s [ 856.582105] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.614394] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 856.614649] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.614928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.615217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.615421] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.615519] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.615588] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.615743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.615826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.615923] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.742880] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-780 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.743181] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-780" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.743379] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-780" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.743858] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-780" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.744541] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.744541] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.744737] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.744997] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.745227] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.745534] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.745830] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.745895] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.746074] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.746293] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.746475] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.746675] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.768392] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.768832] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 856.769256] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.769427] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-780" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.769809] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-1d864f77-2acc-4549-9080-90b3b9d44ff8 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.770307] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.770448] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.770796] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.770972] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d864f77-2acc-4549-9080-90b3b9d44ff8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.803147] env[69656]: INFO networking_nsxv3.common.synchronization [req-6921063e-d47e-46f1-af72-7bba308dbd54 req-414da1a8-1a57-48f6-a3f6-b8c151c7700c tempest-SecurityGroupRulesTestJSON-564151331 tempest-SecurityGroupRulesTestJSON-564151331-project-member] Enqueued Resource ID: 4e0c0bfd-1d2e-41c5-977c-899393e8b581 with Priority: HIGHEST for action security_group_rules [ 856.803760] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e0c0bfd-1d2e-41c5-977c-899393e8b581 with Priority: HIGHEST for action security_group_rules [ 856.804250] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e0c0bfd-1d2e-41c5-977c-899393e8b581 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.804409] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e0c0bfd-1d2e-41c5-977c-899393e8b581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.804506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e0c0bfd-1d2e-41c5-977c-899393e8b581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.804765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e0c0bfd-1d2e-41c5-977c-899393e8b581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.804884] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e0c0bfd-1d2e-41c5-977c-899393e8b581',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.850967] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.928623] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bda66134-74f2-4072-ae41-71132cfa9b91 [ 856.928623] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.928623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.928623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.928623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.928623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.928623] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bda66134-74f2-4072-ae41-71132cfa9b91 already deleted. [ 856.928623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bda66134-74f2-4072-ae41-71132cfa9b91" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.064891] env[69656]: INFO networking_nsxv3.common.synchronization [req-ee58b1ea-7e58-4e45-8689-a4aaa235215d req-00aa8da5-a118-4d56-8e94-4ee8e5906f89 tempest-ServersTestJSON-1445967154 tempest-ServersTestJSON-1445967154-project-member] Enqueued Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGHEST for action security_group_members [ 857.065781] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGHEST for action security_group_members [ 857.065927] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5c76201-04fa-4fa1-bd82-b1756116b4c4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.066138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.066211] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.066436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.067164] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.067328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.067425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.067621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.067774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.067933] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5c76201-04fa-4fa1-bd82-b1756116b4c4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.082835] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.118517] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.276021] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.276021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.276021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.276021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.276021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.276021] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 1d864f77-2acc-4549-9080-90b3b9d44ff8 not found, creating... [ 857.276021] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.276021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.276021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.276021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.276021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.276545] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.276545] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.276545] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.276926] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.277198] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.277452] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 1d864f77-2acc-4549-9080-90b3b9d44ff8 is going to be created. [ 857.303844] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.303844] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.303844] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.303844] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.303844] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.303844] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.324619] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.324619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.324619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.324619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.324619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.324619] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e0c0bfd-1d2e-41c5-977c-899393e8b581 already deleted. [ 857.324619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e0c0bfd-1d2e-41c5-977c-899393e8b581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.355621] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.355621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.355621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.355621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.355621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.355621] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 857.388613] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.388613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.388613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.388613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.388613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.407015] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 857.497320] env[69656]: INFO networking_nsxv3.common.synchronization [req-eaec4c98-ad23-460c-8bd9-0f7457e2320b req-c237777c-b297-4650-afba-9bce9d6ec7b7 tempest-ServerRescueTestJSONUnderV235-1089995768 tempest-ServerRescueTestJSONUnderV235-1089995768-project-member] Enqueued Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 857.497978] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 with Priority: HIGHEST for action security_group_members [ 857.498294] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.498401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.570498] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.570659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.571737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.572014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.584864] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.585027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.585083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.585289] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.585379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.585475] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 is going to be updated. [ 857.593566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.593838] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.593963] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.594052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.594245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.594320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.594413] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 is going to be updated. [ 857.614042] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.614042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.614042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.614042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.614042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.623025] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: IN_PROGRESS for 2s [ 857.623025] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.624024] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.624024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.624024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.624024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.624302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.632146] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 in Status: IN_PROGRESS for 2s [ 858.127255] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.127446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.127487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.127734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.127853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.127980] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be updated. [ 858.166674] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.166834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.166907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.167463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.167596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.177992] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 858.191648] env[69656]: INFO networking_nsxv3.common.synchronization [req-3f1fb8b6-dbc1-4a02-bf79-927b7be19a9d req-993b5858-6040-4632-bd0e-1543b3ac9bc3 tempest-ServerDiskConfigTestJSON-2110996415 tempest-ServerDiskConfigTestJSON-2110996415-project-member] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 858.191648] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 858.191648] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.191843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.191843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.191990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.192174] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.192652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.192652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.192652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.192652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.192893] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.316209] env[69656]: INFO networking_nsxv3.common.synchronization [req-da82dadf-12f8-4dc5-adf3-45031496acee req-cda35850-c6c7-4bff-b363-e6cfb8bdf037 service nova] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_rules [ 858.316209] env[69656]: INFO networking_nsxv3.common.synchronization [req-da82dadf-12f8-4dc5-adf3-45031496acee req-cda35850-c6c7-4bff-b363-e6cfb8bdf037 service nova] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 858.316209] env[69656]: INFO networking_nsxv3.common.synchronization [req-da82dadf-12f8-4dc5-adf3-45031496acee req-cda35850-c6c7-4bff-b363-e6cfb8bdf037 service nova] Enqueued Resource ID: 1d864f77-2acc-4549-9080-90b3b9d44ff8 with Priority: HIGHEST for action port [ 858.316209] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_rules [ 858.319274] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 858.319274] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d864f77-2acc-4549-9080-90b3b9d44ff8 with Priority: HIGHEST for action port [ 858.319274] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.320463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.320549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.322543] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.322543] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.324719] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.324719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.324868] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d864f77-2acc-4549-9080-90b3b9d44ff8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.325017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.325063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.325689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.325689] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d864f77-2acc-4549-9080-90b3b9d44ff8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.521920] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: SUCCESS [ 858.522242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.523475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.523749] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.523970] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.524113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.524183] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.524339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.524422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.524687] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.524687] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.524783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.524817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.525113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.525203] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.525298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.525488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.525617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.525617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.525726] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.525812] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.559897] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-940 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.560182] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.560337] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.560778] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.561698] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.561698] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.561698] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.561698] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.562040] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.562040] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.562213] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.562348] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.562459] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.562574] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.562682] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.562813] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.566617] env[69656]: INFO networking_nsxv3.common.synchronization [req-7241c92a-7310-4f47-89cb-c2a2fdc0e85b req-52b712e1-bde9-4f63-8a62-e6d7d9efb93a tempest-SecurityGroupRulesTestJSON-564151331 tempest-SecurityGroupRulesTestJSON-564151331-project-member] Enqueued Resource ID: 85ef53cb-6df1-4de4-b8ea-84b545fc48b0 with Priority: HIGHEST for action security_group_rules [ 858.567280] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85ef53cb-6df1-4de4-b8ea-84b545fc48b0 with Priority: HIGHEST for action security_group_rules [ 858.568067] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85ef53cb-6df1-4de4-b8ea-84b545fc48b0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.568067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85ef53cb-6df1-4de4-b8ea-84b545fc48b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.568243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85ef53cb-6df1-4de4-b8ea-84b545fc48b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.568908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85ef53cb-6df1-4de4-b8ea-84b545fc48b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.568908] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85ef53cb-6df1-4de4-b8ea-84b545fc48b0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.584773] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.584977] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 858.585162] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.585358] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.585668] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-d0305c8a-1d9a-44ed-9ee1-56f96dab1315 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.585865] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-d0305c8a-1d9a-44ed-9ee1-56f96dab1315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.586170] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-d0305c8a-1d9a-44ed-9ee1-56f96dab1315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.587313] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-d0305c8a-1d9a-44ed-9ee1-56f96dab1315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.587465] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0305c8a-1d9a-44ed-9ee1-56f96dab1315',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.694617] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.694784] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.694853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.696586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.696586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.696586] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.696586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.696799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.696799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.696859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.696989] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b already deleted. [ 858.697048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.827207] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.827351] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.831197] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d864f77-2acc-4549-9080-90b3b9d44ff8 with status ACTIVE [ 858.831469] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.833049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.833049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.833049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.833049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.833049] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.833049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.833049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.833049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.833049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.833049] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.833049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.833049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.833049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.833049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.833735] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d864f77-2acc-4549-9080-90b3b9d44ff8 is going to be updated. [ 858.855516] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.855670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.855736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.855945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.856096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.856258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.028296] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe7fb2d8-2929-4f36-a2da-bafb532a875d: rpc.has_security_group_logging(os_id): False [ 859.050951] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.050951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.050951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.050951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.050951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.050951] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.050951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.050951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.050951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.050951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.050951] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.050951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.050951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.050951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.050951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.051644] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.051644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.051644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.051644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.051644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.051644] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d is going to be created. [ 859.086592] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.086774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.086825] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.087008] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.087128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.087224] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85ef53cb-6df1-4de4-b8ea-84b545fc48b0 already deleted. [ 859.087309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85ef53cb-6df1-4de4-b8ea-84b545fc48b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.089987] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.090215] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.090409] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.090570] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.090713] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.090865] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port d0305c8a-1d9a-44ed-9ee1-56f96dab1315 not found, creating... [ 859.091223] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.091431] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.091593] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.091843] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.092039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.092365] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.092560] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.092721] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.092968] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.093474] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.093474] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: d0305c8a-1d9a-44ed-9ee1-56f96dab1315 is going to be created. [ 859.109990] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.109990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.109990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.109990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.109990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.120045] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.120045] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.120300] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.120547] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.120834] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.121141] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-d0305c8a-1d9a-44ed-9ee1-56f96dab1315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.122596] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: IN_PROGRESS for 2s [ 859.415985] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 859.416252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.416421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.416712] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.416907] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.417037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.417102] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.417267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.417349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.417446] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.632825] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: SUCCESS [ 859.633166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.634069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.634276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.634461] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.634574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.634638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.634778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.634856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.634941] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.639770] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d79c92-ce40-4ea6-bf34-2e0fcc875300 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.639770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.639770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.639770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.639770] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.639770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.639770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.639770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.640218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.640218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.640218] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.644019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.644019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.644019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.644019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.644019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.644019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.644019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.644019] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.649670] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 in Status: SUCCESS [ 859.649864] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 deletion is rescheduled due to dependency. [ 859.650047] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.693018] env[69656]: INFO networking_nsxv3.common.synchronization [req-dd909721-436c-485c-96bd-558ecbbfcbf2 req-5ce87df0-63ee-4107-9846-85c1f8c85c87 tempest-SecurityGroupRulesTestJSON-564151331 tempest-SecurityGroupRulesTestJSON-564151331-project-member] Enqueued Resource ID: a3970b7d-4e06-4f04-aaea-da1f70a7f955 with Priority: HIGHEST for action security_group_rules [ 859.693018] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3970b7d-4e06-4f04-aaea-da1f70a7f955 with Priority: HIGHEST for action security_group_rules [ 859.693744] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3970b7d-4e06-4f04-aaea-da1f70a7f955 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.694034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3970b7d-4e06-4f04-aaea-da1f70a7f955" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.694861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3970b7d-4e06-4f04-aaea-da1f70a7f955" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.695471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3970b7d-4e06-4f04-aaea-da1f70a7f955" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.695689] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3970b7d-4e06-4f04-aaea-da1f70a7f955',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.825531] env[69656]: INFO networking_nsxv3.common.synchronization [req-3f1fb8b6-dbc1-4a02-bf79-927b7be19a9d req-0e6069cb-af87-43ce-aa4a-5a5f0eda660f service nova] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_rules [ 859.825531] env[69656]: INFO networking_nsxv3.common.synchronization [req-3f1fb8b6-dbc1-4a02-bf79-927b7be19a9d req-0e6069cb-af87-43ce-aa4a-5a5f0eda660f service nova] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 859.825531] env[69656]: INFO networking_nsxv3.common.synchronization [req-3f1fb8b6-dbc1-4a02-bf79-927b7be19a9d req-0e6069cb-af87-43ce-aa4a-5a5f0eda660f service nova] Enqueued Resource ID: d0305c8a-1d9a-44ed-9ee1-56f96dab1315 with Priority: HIGHEST for action port [ 859.825531] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_rules [ 859.825531] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 859.825531] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0305c8a-1d9a-44ed-9ee1-56f96dab1315 with Priority: HIGHEST for action port [ 859.825531] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.825531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.825531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.825531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.826641] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.831232] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.831349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.831416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.831600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.831751] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.831911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.831911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.832055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.832136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.832222] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.835022] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0305c8a-1d9a-44ed-9ee1-56f96dab1315 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.835022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0305c8a-1d9a-44ed-9ee1-56f96dab1315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.835022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0305c8a-1d9a-44ed-9ee1-56f96dab1315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.835022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0305c8a-1d9a-44ed-9ee1-56f96dab1315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.835022] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0305c8a-1d9a-44ed-9ee1-56f96dab1315',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.920293] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.144742] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39d79c92-ce40-4ea6-bf34-2e0fcc875300: rpc.has_security_group_logging(os_id): False [ 860.145843] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.146034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.146084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.146418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.164651] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.164776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.165805] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.166081] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.166214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.166302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.166575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.166699] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.166804] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 is going to be updated. [ 860.169032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.169291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.169392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.169677] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.169845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.169946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.170220] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.170333] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.170587] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.170694] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.170792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.170991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.171157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.171422] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.171589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.171689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.171871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.172021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.172123] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 is going to be updated. [ 860.186581] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 860.186779] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.186978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.187208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.187404] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.187518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.187615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.187816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.187907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.188024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.188123] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.211774] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.211960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.212075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.212323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.212493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.228639] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.228809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.228890] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.229131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.229223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.229328] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3970b7d-4e06-4f04-aaea-da1f70a7f955 already deleted. [ 860.229417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3970b7d-4e06-4f04-aaea-da1f70a7f955" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.230459] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: IN_PROGRESS for 2s [ 860.252472] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.252613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.252682] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.252894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.253052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.265146] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: IN_PROGRESS for 2s [ 860.335491] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.336609] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.336704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.337040] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0305c8a-1d9a-44ed-9ee1-56f96dab1315 with status ACTIVE [ 860.337198] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.337343] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.337434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.337742] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.337878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.339229] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.339229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.339229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.339229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.339229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.339229] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.339229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.339229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.339229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.339689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.339689] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0305c8a-1d9a-44ed-9ee1-56f96dab1315 is going to be updated. [ 860.368106] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.368496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.368496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.368660] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.368866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.369107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0305c8a-1d9a-44ed-9ee1-56f96dab1315" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.421941] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.691980] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.692316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.692316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.692460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.692633] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.692731] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.692794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.692936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.693034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.693121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.693263] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.693352] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.693411] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.693547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.693678] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.693764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.693823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.693955] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.694037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.694120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.694206] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.768496] env[69656]: INFO networking_nsxv3.common.synchronization [req-e28d3383-aea1-4a4c-aa43-ff55dd2abfa5 req-6be7edb1-844e-40e5-8b90-67d03b3a0fab tempest-ImagesTestJSON-514277302 tempest-ImagesTestJSON-514277302-project-member] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 860.768496] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 860.768731] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.768857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.768921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.769203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.769355] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.769451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.769510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.770587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.770681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.770779] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.837864] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.926936] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.927132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.927209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.927704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.927864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.927997] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 860.954602] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.954766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.954836] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.955110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.955245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.963484] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 861.133489] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: SUCCESS [ 861.133762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.133973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.134306] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.134360] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.197030] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d9740de-f67c-4fbd-a249-44afc4caaef1: rpc.has_security_group_logging(os_id): False [ 861.224932] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.225117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.225159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.225365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.249528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.249930] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.250080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.250149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.250393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.250462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.250620] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.250716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.250775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.250951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.251119] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.251318] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.251412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.251464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.251643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.251739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.251829] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be updated. [ 861.258536] env[69656]: INFO networking_nsxv3.common.synchronization [req-48f53aac-cbec-4e43-b459-b79e7f3f3a20 req-cc91c422-69dc-497c-9acb-a1347c4b93f3 tempest-SecurityGroupRulesTestJSON-564151331 tempest-SecurityGroupRulesTestJSON-564151331-project-member] Enqueued Resource ID: 0f3f2f1a-5529-44a8-8623-36f79cf6a79b with Priority: HIGHEST for action security_group_rules [ 861.259111] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3f2f1a-5529-44a8-8623-36f79cf6a79b with Priority: HIGHEST for action security_group_rules [ 861.259404] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.259536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.259588] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.259816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.260016] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f3f2f1a-5529-44a8-8623-36f79cf6a79b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.273084] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.273250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.273325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.273540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.295300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.295603] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.295716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.295779] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.295965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.296649] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.296649] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 861.321719] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.321863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.321940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.322208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.322350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.324353] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.324474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.324541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.324707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.326390] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.332702] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 861.335603] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 861.341444] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.341444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.341444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.341444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.341444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.341444] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be created. [ 861.383043] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.383043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.383043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.383043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.383043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.399502] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: UNINITIALIZED for 2s [ 861.533975] env[69656]: INFO networking_nsxv3.common.synchronization [req-c54d52db-f1ad-4631-98b5-c34d524e9f6b req-a53d539b-23cb-4d3c-9747-275777e0a361 tempest-SecurityGroupRulesTestJSON-564151331 tempest-SecurityGroupRulesTestJSON-564151331-project-member] Enqueued Resource ID: 0f3f2f1a-5529-44a8-8623-36f79cf6a79b with Priority: HIGHEST for action security_group_rules [ 861.534513] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3f2f1a-5529-44a8-8623-36f79cf6a79b with Priority: HIGHEST for action security_group_rules [ 861.534802] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.534905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.636939] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.637259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.637395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.637588] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.637768] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.637881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.637947] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.638123] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.638215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.638303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.638393] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.778285] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.778594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.778594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.778701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.779076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.779076] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f3f2f1a-5529-44a8-8623-36f79cf6a79b already deleted. [ 861.779076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.779262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.779262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.779349] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f3f2f1a-5529-44a8-8623-36f79cf6a79b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.881211] env[69656]: INFO networking_nsxv3.common.synchronization [req-faa77e17-3858-45ce-99d0-e073a62d1749 req-e373c539-6367-416a-9450-70d47076effc tempest-SecurityGroupRulesTestJSON-564151331 tempest-SecurityGroupRulesTestJSON-564151331-project-member] Enqueued Resource ID: 0f3f2f1a-5529-44a8-8623-36f79cf6a79b with Priority: HIGHEST for action security_group_rules [ 861.881924] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3f2f1a-5529-44a8-8623-36f79cf6a79b with Priority: HIGHEST for action security_group_rules [ 861.888043] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.888043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.141379] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.141499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.141605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.141794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.141965] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.142085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.142204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.142622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.142864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.143019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.144035] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.144190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.144290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.144420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.144603] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.144682] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.144741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.144887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.145169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.145290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.145566] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.242887] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: SUCCESS [ 862.243291] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 deletion is rescheduled due to dependency. [ 862.243520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.283486] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 in Status: SUCCESS [ 862.283713] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.284329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.284329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.284329] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.309210] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.309486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.309597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.309891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.310061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.310230] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f3f2f1a-5529-44a8-8623-36f79cf6a79b already deleted. [ 862.310414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.312736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.313082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.313245] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f3f2f1a-5529-44a8-8623-36f79cf6a79b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.653427] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe7fb2d8-2929-4f36-a2da-bafb532a875d: rpc.has_security_group_logging(os_id): False [ 862.672022] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.672022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.672022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.672022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.672022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.672022] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.672022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.672022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.672022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.672022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.672022] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.672022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.672022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.672022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.672022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.672567] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.672567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.672567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.672567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.672567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.672567] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d is going to be updated. [ 862.731873] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.731873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.731873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.731873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.731873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.741173] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: IN_PROGRESS for 2s [ 862.808220] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.808503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.808503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.808756] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.808876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.809012] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 is going to be deleted. [ 862.855643] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.855821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.855921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.856329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.856329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.856448] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f3f2f1a-5529-44a8-8623-36f79cf6a79b already deleted. [ 862.856481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f3f2f1a-5529-44a8-8623-36f79cf6a79b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.895456] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.895456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.895456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.895696] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.895777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.895897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.896063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.896223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.896335] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39d79c92-ce40-4ea6-bf34-2e0fcc875300',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.974329] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 862.974580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.974786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.975019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.975253] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.975342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.975537] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.975644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.975736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.975840] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.975954] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.345197] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 863.345370] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e deletion is rescheduled due to dependency. [ 863.345485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.350076] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 863.353269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.406812] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 863.407037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.407202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.407424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.407611] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.407729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.407794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.407957] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.408055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.408136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.408269] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.413439] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.413562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.413638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.413818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.413897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.413998] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39d79c92-ce40-4ea6-bf34-2e0fcc875300 already deleted. [ 863.414088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39d79c92-ce40-4ea6-bf34-2e0fcc875300" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.478663] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.478788] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.478788] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.479073] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.479442] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.479442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.479442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.479674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.479728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.479808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.479986] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.480135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.480238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.480350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.481107] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.481107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.481107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.481107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.481107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.481107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.481775] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.914634] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.914634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.914634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.914634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.914634] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.914634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.914634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.914634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.914634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.914634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.914634] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.914634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.914634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.914634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.914634] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.914634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.915936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.915936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.915936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.915936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.915936] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.983321] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22763ac9-09b1-45ba-b8a9-6df4fc54e141: rpc.has_security_group_logging(os_id): False [ 864.000765] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.001303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.001474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.001748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.001905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.002356] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.002516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.002587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.002774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.002875] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.003098] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.003216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.003250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.003395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.003471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.003659] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.003751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.003812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.003949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.004445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.004613] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 864.065565] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.065792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.065792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.066095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.066295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.081850] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 864.420138] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ceadc5a6-0e5a-4475-96ab-3f4a1cec315b: rpc.has_security_group_logging(os_id): False [ 864.437524] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.437754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.437842] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.438050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.438137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.438325] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.438432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.438487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.438625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.438692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.438866] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.438969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.439040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.439155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.439218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.439417] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.439533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.439656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.439706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.439811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.439811] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be created. [ 864.495775] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.496048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.496048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.497949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.497949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.507694] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 864.758540] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: SUCCESS [ 864.758760] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.759033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.759264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.759363] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.262828] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.263107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.263154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.263479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.263652] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.263752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.263813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.263987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.264083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.264170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.264257] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.767552] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.767720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.767789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.768064] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.768246] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.768353] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.768418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.768580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.768720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.768774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.768902] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.769028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.769114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.769235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.769373] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.769462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.769521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.769654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.769729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.769811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.769945] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.096836] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 866.097086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.273446] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe7fb2d8-2929-4f36-a2da-bafb532a875d: rpc.has_security_group_logging(os_id): False [ 866.291348] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.294023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.294023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.294023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.294023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.294023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.294023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.294023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.294023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.294023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.294023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.294023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.294023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.294023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.294023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.294606] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.294606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.294606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.294606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.294606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.294606] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d is going to be updated. [ 866.355147] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.355147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.355147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.355147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.355147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.366969] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: IN_PROGRESS for 2s [ 866.523151] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 866.524510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.885319] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 866.885647] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 866.929339] env[69656]: INFO networking_nsxv3.common.synchronization [req-59acac40-0871-43cf-8efd-326367c960e4 req-f5afc32f-fac2-485c-9427-732b97c8e500 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_members [ 866.929483] env[69656]: INFO networking_nsxv3.common.synchronization [req-59acac40-0871-43cf-8efd-326367c960e4 req-f5afc32f-fac2-485c-9427-732b97c8e500 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 866.932369] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_members [ 866.932674] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 866.933040] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.933214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.933308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.935438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.935438] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.935438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.935438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.935438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.935438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.935438] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.938072] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.938072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.938072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.938196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.938309] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.938404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.938466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.938602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.938683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.938772] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.996361] env[69656]: INFO networking_nsxv3.common.synchronization [req-59acac40-0871-43cf-8efd-326367c960e4 req-f5afc32f-fac2-485c-9427-732b97c8e500 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_rules [ 866.996558] env[69656]: INFO networking_nsxv3.common.synchronization [req-59acac40-0871-43cf-8efd-326367c960e4 req-f5afc32f-fac2-485c-9427-732b97c8e500 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 866.996696] env[69656]: INFO networking_nsxv3.common.synchronization [req-59acac40-0871-43cf-8efd-326367c960e4 req-f5afc32f-fac2-485c-9427-732b97c8e500 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_rules [ 866.996826] env[69656]: INFO networking_nsxv3.common.synchronization [req-59acac40-0871-43cf-8efd-326367c960e4 req-f5afc32f-fac2-485c-9427-732b97c8e500 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_members [ 866.996956] env[69656]: INFO networking_nsxv3.common.synchronization [req-59acac40-0871-43cf-8efd-326367c960e4 req-f5afc32f-fac2-485c-9427-732b97c8e500 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 1d864f77-2acc-4549-9080-90b3b9d44ff8 with Priority: HIGHEST for action port [ 866.997987] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_rules [ 866.997987] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_rules [ 866.997987] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d864f77-2acc-4549-9080-90b3b9d44ff8 with Priority: HIGHEST for action port [ 866.998183] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 866.998183] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_members [ 867.000165] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.000165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.000165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.000165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.000165] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.000467] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.001118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.001214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.001473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.001519] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.003598] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d864f77-2acc-4549-9080-90b3b9d44ff8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.003598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.003598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.003598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.003598] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d864f77-2acc-4549-9080-90b3b9d44ff8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.005881] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.006114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.006422] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.006704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.444083] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.445459] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.508232] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d864f77-2acc-4549-9080-90b3b9d44ff8 with status ACTIVE [ 867.508522] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.508675] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.508773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.509036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.509136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.509388] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.509558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.509647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.509873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.509992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.510250] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.510394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.510476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.510878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.510878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.510878] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d864f77-2acc-4549-9080-90b3b9d44ff8 is going to be updated. [ 867.512402] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.512527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.512807] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.512934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.531995] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.532253] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.532356] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.532549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.532688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.532850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.951910] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.954457] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.385814] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: SUCCESS [ 868.386028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.455739] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.456087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.456087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.456489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.456590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.456700] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef is going to be created. [ 868.458441] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.458562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.458635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.458791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.458872] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.458963] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 868.485023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.485023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.485023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.485023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.485023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.485023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.485023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.485023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.485023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.485023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.491963] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef in Status: UNINITIALIZED for 2s [ 868.492464] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 868.696826] env[69656]: INFO networking_nsxv3.common.synchronization [None req-c1d5abfb-0991-48a4-b2c8-b2b8c706c51d None None] Enqueued Resource ID: 72fe834f-049a-4e5c-bd98-260ce7c927fe with Priority: HIGHEST for action port [ 868.697423] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72fe834f-049a-4e5c-bd98-260ce7c927fe with Priority: HIGHEST for action port [ 868.697735] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-72fe834f-049a-4e5c-bd98-260ce7c927fe taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.698194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72fe834f-049a-4e5c-bd98-260ce7c927fe" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.698194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72fe834f-049a-4e5c-bd98-260ce7c927fe" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.698774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72fe834f-049a-4e5c-bd98-260ce7c927fe" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.698871] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72fe834f-049a-4e5c-bd98-260ce7c927fe',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.202031] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72fe834f-049a-4e5c-bd98-260ce7c927fe [ 869.202031] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.202031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.202031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.202354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.202354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.202421] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72fe834f-049a-4e5c-bd98-260ce7c927fe already deleted. [ 869.202456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72fe834f-049a-4e5c-bd98-260ce7c927fe" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.279351] env[69656]: INFO networking_nsxv3.common.synchronization [None req-7da6a3ed-2969-4f48-94ff-8f8e74786a44 tempest-AttachInterfacesUnderV243Test-816866037 tempest-AttachInterfacesUnderV243Test-816866037-project-member] Enqueued Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_rules [ 869.279351] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_rules [ 869.279351] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.279544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.279544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.279895] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.279995] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.359990] env[69656]: INFO networking_nsxv3.common.synchronization [None req-025b29bc-c18e-4e6c-90f8-904d40b55692 tempest-AttachInterfacesUnderV243Test-816866037 tempest-AttachInterfacesUnderV243Test-816866037-project-member] Enqueued Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_rules [ 869.360685] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_rules [ 869.361383] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.361494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.804690] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.805031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.805031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.805204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.805320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.805436] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7521520c-f746-46f0-bf0e-85f9284fde61 already deleted. [ 869.805535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.805702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.805915] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.806113] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.328480] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.328644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.328763] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.328944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.329093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.329175] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7521520c-f746-46f0-bf0e-85f9284fde61 already deleted. [ 870.329260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.502557] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef in Status: SUCCESS [ 870.504015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.504015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.504015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.504015] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.504015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.504015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.504015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.504015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.504015] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.505388] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 870.506747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.506747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.506747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.506747] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.506747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.506747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.506747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.506747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.506747] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.008658] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.009693] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.275186] env[69656]: INFO networking_nsxv3.common.synchronization [None req-31cbcfcc-f89d-4a60-a7f6-07762252dab0 None None] Enqueued Resource ID: 21ef8c55-a4f3-424a-87b0-1b6169d9229e with Priority: HIGHEST for action port [ 871.275453] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21ef8c55-a4f3-424a-87b0-1b6169d9229e with Priority: HIGHEST for action port [ 871.276027] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-21ef8c55-a4f3-424a-87b0-1b6169d9229e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.276159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21ef8c55-a4f3-424a-87b0-1b6169d9229e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.276227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21ef8c55-a4f3-424a-87b0-1b6169d9229e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.276471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21ef8c55-a4f3-424a-87b0-1b6169d9229e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.276554] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21ef8c55-a4f3-424a-87b0-1b6169d9229e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.511679] env[69656]: INFO networking_nsxv3.common.synchronization [req-cf35b444-900d-47f5-bb62-75cd37f6c192 req-a93b808c-d89b-4ec3-b056-685110523325 tempest-ImagesOneServerNegativeTestJSON-384940824 tempest-ImagesOneServerNegativeTestJSON-384940824-project-member] Enqueued Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 871.511679] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.513028] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 871.517845] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.521019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.521019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.521019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.521019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.521019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.521019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.521019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.521019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.521019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.521019] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.780949] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21ef8c55-a4f3-424a-87b0-1b6169d9229e [ 871.781199] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.781335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.781406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.781612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.782515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.782515] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21ef8c55-a4f3-424a-87b0-1b6169d9229e already deleted. [ 871.782515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21ef8c55-a4f3-424a-87b0-1b6169d9229e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.018732] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.019246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.019246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.019246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.019246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.019478] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef is going to be updated. [ 872.021111] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.021297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.021297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.021462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.021495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.021583] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 872.023370] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.023502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.023560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.023691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.042812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.043078] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.043235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.043277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.043445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.043526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.043616] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf is going to be updated. [ 872.048870] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.048998] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.049095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.049257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.049498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.050918] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.055068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.055170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.055351] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.055545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.063805] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef in Status: IN_PROGRESS for 2s [ 872.064636] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 872.073018] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.073018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.073018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.073018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.073018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.080476] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: IN_PROGRESS for 2s [ 872.308019] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.308019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.308019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.308019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.308019] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.308019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.308019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.308019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.308019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.308019] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.309261] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 872.309261] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 872.309447] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 872.309447] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.309550] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 872.309736] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 872.327111] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 872.327216] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 872.327352] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 872.327528] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.327827] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-f1ab676a-c101-45e0-a2e0-469d65ddd666 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.327994] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-f1ab676a-c101-45e0-a2e0-469d65ddd666" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.328130] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-f1ab676a-c101-45e0-a2e0-469d65ddd666" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.328424] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-f1ab676a-c101-45e0-a2e0-469d65ddd666" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.328565] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1ab676a-c101-45e0-a2e0-469d65ddd666',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.831433] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.831648] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.831804] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.836020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.836020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.836020] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port f1ab676a-c101-45e0-a2e0-469d65ddd666 not found, creating... [ 872.836020] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.836020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.836020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.836020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.836020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.836020] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.836020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.836768] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.836768] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.836768] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.836768] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: f1ab676a-c101-45e0-a2e0-469d65ddd666 is going to be created. [ 872.857302] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.857302] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.857302] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.857606] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.857938] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.858236] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-f1ab676a-c101-45e0-a2e0-469d65ddd666" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.324249] env[69656]: INFO networking_nsxv3.common.synchronization [req-943cd18b-5679-4d3f-81c1-5139ad329f9e req-ab3c4af0-1551-461d-b9d1-6693b8a82953 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 with Priority: HIGHEST for action security_group_members [ 873.324600] env[69656]: INFO networking_nsxv3.common.synchronization [req-943cd18b-5679-4d3f-81c1-5139ad329f9e req-ab3c4af0-1551-461d-b9d1-6693b8a82953 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 873.324812] env[69656]: INFO networking_nsxv3.common.synchronization [req-943cd18b-5679-4d3f-81c1-5139ad329f9e req-ab3c4af0-1551-461d-b9d1-6693b8a82953 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_members [ 873.325490] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 with Priority: HIGHEST for action security_group_members [ 873.325789] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 873.326018] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_members [ 873.326387] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-18364875-b9a9-4b62-89e0-3b1c941ee870 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.326570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.326666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.327165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.327253] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.327408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.327508] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.327722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.327774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.327884] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18364875-b9a9-4b62-89e0-3b1c941ee870',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.328754] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.328906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.329125] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.329243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.426661] env[69656]: INFO networking_nsxv3.common.synchronization [req-943cd18b-5679-4d3f-81c1-5139ad329f9e req-ab3c4af0-1551-461d-b9d1-6693b8a82953 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 with Priority: HIGHEST for action security_group_rules [ 873.426900] env[69656]: INFO networking_nsxv3.common.synchronization [req-943cd18b-5679-4d3f-81c1-5139ad329f9e req-ab3c4af0-1551-461d-b9d1-6693b8a82953 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 with Priority: HIGHEST for action security_group_members [ 873.426985] env[69656]: INFO networking_nsxv3.common.synchronization [req-943cd18b-5679-4d3f-81c1-5139ad329f9e req-ab3c4af0-1551-461d-b9d1-6693b8a82953 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_rules [ 873.427135] env[69656]: INFO networking_nsxv3.common.synchronization [req-943cd18b-5679-4d3f-81c1-5139ad329f9e req-ab3c4af0-1551-461d-b9d1-6693b8a82953 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 873.427263] env[69656]: INFO networking_nsxv3.common.synchronization [req-943cd18b-5679-4d3f-81c1-5139ad329f9e req-ab3c4af0-1551-461d-b9d1-6693b8a82953 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_rules [ 873.427407] env[69656]: INFO networking_nsxv3.common.synchronization [req-943cd18b-5679-4d3f-81c1-5139ad329f9e req-ab3c4af0-1551-461d-b9d1-6693b8a82953 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_members [ 873.427506] env[69656]: INFO networking_nsxv3.common.synchronization [req-943cd18b-5679-4d3f-81c1-5139ad329f9e req-ab3c4af0-1551-461d-b9d1-6693b8a82953 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 1d864f77-2acc-4549-9080-90b3b9d44ff8 with Priority: HIGHEST for action port [ 873.428080] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 with Priority: HIGHEST for action security_group_rules [ 873.428595] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_rules [ 873.428595] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_members [ 873.428700] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d864f77-2acc-4549-9080-90b3b9d44ff8 with Priority: HIGHEST for action port [ 873.428839] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_rules [ 873.428872] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 with Priority: HIGHEST for action security_group_members [ 873.428956] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 873.429252] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18364875-b9a9-4b62-89e0-3b1c941ee870 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.429375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.429437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.431164] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.431259] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18364875-b9a9-4b62-89e0-3b1c941ee870',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.432262] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.432262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.432440] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.432538] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.432686] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d864f77-2acc-4549-9080-90b3b9d44ff8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.432847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.432847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.433010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.433089] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d864f77-2acc-4549-9080-90b3b9d44ff8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.434060] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.434060] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.434256] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-18364875-b9a9-4b62-89e0-3b1c941ee870 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.434256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.434382] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.434449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.804324] env[69656]: INFO networking_nsxv3.common.synchronization [req-cf35b444-900d-47f5-bb62-75cd37f6c192 req-efa57823-350f-40bc-bf7b-69d109d1204f service nova] Enqueued Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_rules [ 873.804583] env[69656]: INFO networking_nsxv3.common.synchronization [req-cf35b444-900d-47f5-bb62-75cd37f6c192 req-efa57823-350f-40bc-bf7b-69d109d1204f service nova] Enqueued Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 873.806439] env[69656]: INFO networking_nsxv3.common.synchronization [req-cf35b444-900d-47f5-bb62-75cd37f6c192 req-efa57823-350f-40bc-bf7b-69d109d1204f service nova] Enqueued Resource ID: f1ab676a-c101-45e0-a2e0-469d65ddd666 with Priority: HIGHEST for action port [ 873.806439] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_rules [ 873.806863] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 873.806937] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1ab676a-c101-45e0-a2e0-469d65ddd666 with Priority: HIGHEST for action port [ 873.807555] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.807808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.807964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.808313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.808833] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.810026] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.810026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.810244] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1ab676a-c101-45e0-a2e0-469d65ddd666 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.810445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1ab676a-c101-45e0-a2e0-469d65ddd666" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.810595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1ab676a-c101-45e0-a2e0-469d65ddd666" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.810913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1ab676a-c101-45e0-a2e0-469d65ddd666" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.811765] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1ab676a-c101-45e0-a2e0-469d65ddd666',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.835588] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18364875-b9a9-4b62-89e0-3b1c941ee870',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.935969] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d864f77-2acc-4549-9080-90b3b9d44ff8 with status ACTIVE [ 873.936689] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.936871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.936947] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.937213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.937329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.937545] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.937656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.937722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.937920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.938022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.938235] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.938339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.938401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.938544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.938635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.938758] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d864f77-2acc-4549-9080-90b3b9d44ff8 is going to be updated. [ 873.941088] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-18364875-b9a9-4b62-89e0-3b1c941ee870 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.941392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.959502] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.959684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.959766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.960067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.963471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.963736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d864f77-2acc-4549-9080-90b3b9d44ff8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.075309] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef in Status: SUCCESS [ 874.075531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.075686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.075895] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.076107] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.076226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.076296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.076466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.076552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.076642] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.076736] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.079234] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 874.079234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.079234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.079234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.079234] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.079234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.079234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.079871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.079871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.079871] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.080443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.080605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.080761] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.080863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.080967] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.081175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.081253] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.081341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.081418] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.083241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.083404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.083557] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.083662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.083716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.083947] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.084057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.084128] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.093520] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: SUCCESS [ 874.093693] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf deletion is rescheduled due to dependency. [ 874.093800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.094261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.094594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.094846] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.095170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.095170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.095294] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.095294] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.095398] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.313296] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.313296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.313469] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1ab676a-c101-45e0-a2e0-469d65ddd666 with status ACTIVE [ 874.313717] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.313815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.313815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.314016] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.314141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.314319] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.314416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.314478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.314636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.314711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.314889] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.314982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.315056] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.315204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.315352] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.315352] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1ab676a-c101-45e0-a2e0-469d65ddd666 is going to be updated. [ 874.336810] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.337104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.337104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.337282] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.337370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.337521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1ab676a-c101-45e0-a2e0-469d65ddd666" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.337733] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18364875-b9a9-4b62-89e0-3b1c941ee870',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.583242] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.584558] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.585896] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.586292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.586675] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.597661] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.714830] env[69656]: INFO networking_nsxv3.common.synchronization [req-f96e5248-a297-4b1a-a00c-cae73b4aa033 req-6227273c-6a8b-428d-8eb5-6478a397ada9 tempest-ServersWithSpecificFlavorTestJSON-7449257 tempest-ServersWithSpecificFlavorTestJSON-7449257-project-member] Enqueued Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_members [ 874.715508] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_members [ 874.716271] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.717700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.717972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.718375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.718789] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.719037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.719190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.719466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.719628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.719793] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.840471] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.840630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.840702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.841042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.841114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.841240] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 is going to be created. [ 874.862288] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.862439] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.862495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.862701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.862857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.871333] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 in Status: UNINITIALIZED for 2s [ 875.086302] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.091150] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef: rpc.has_security_group_logging(os_id): False [ 875.092338] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.103108] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.108907] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.109064] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.109120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.111340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.111340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.111340] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.111340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.111340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.111340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.111340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.111340] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef is going to be created. [ 875.182022] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.182022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.182022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.182022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.183061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.196893] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef in Status: IN_PROGRESS for 2s [ 875.225769] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.225769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.225769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.225769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.225769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.225769] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.225769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.225769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.225769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.225769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.225769] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 is going to be updated. [ 875.273134] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.273134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.273318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.273471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.273631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.291670] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: IN_PROGRESS for 2s [ 875.594235] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.594235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.594235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.594235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.594235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.594235] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef is going to be updated. [ 875.594235] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.594235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.594830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.594830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.594830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.594830] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 875.605280] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.606022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.606022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.606022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.606022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.606022] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf is going to be updated. [ 875.633033] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.633033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.633033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.633033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.633033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.635130] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.635330] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.635470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.636020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.636572] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.639422] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.639823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.640095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.640359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.640572] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.650703] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: IN_PROGRESS for 2s [ 875.651533] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 875.652122] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef in Status: IN_PROGRESS for 2s [ 876.478784] env[69656]: INFO networking_nsxv3.common.synchronization [req-d1eb896d-e913-402e-b74c-60e69e6b5b7f req-d56d16d6-a7eb-4ade-b762-fcbc79324756 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 with Priority: HIGHEST for action security_group_members [ 876.478969] env[69656]: INFO networking_nsxv3.common.synchronization [req-d1eb896d-e913-402e-b74c-60e69e6b5b7f req-d56d16d6-a7eb-4ade-b762-fcbc79324756 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_members [ 876.479124] env[69656]: INFO networking_nsxv3.common.synchronization [req-d1eb896d-e913-402e-b74c-60e69e6b5b7f req-d56d16d6-a7eb-4ade-b762-fcbc79324756 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 876.479653] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 with Priority: HIGHEST for action security_group_members [ 876.480663] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef with Priority: HIGHEST for action security_group_members [ 876.480663] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 876.483864] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-18364875-b9a9-4b62-89e0-3b1c941ee870 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.483864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.483864] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.483864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.483864] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.483864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.627516] env[69656]: INFO networking_nsxv3.common.synchronization [req-f5b9fcae-6aa6-46ff-8ac5-ade65fe2e238 req-0c82836d-873a-4a04-87fe-a63ba0e100f9 tempest-ListServerFiltersTestJSON-1060652857 tempest-ListServerFiltersTestJSON-1060652857-project-member] Enqueued Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 876.628827] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 876.629504] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.629648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.629767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.630217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.630442] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.630589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.630674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.632700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.632700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.632700] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.884978] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 in Status: SUCCESS [ 876.885253] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.885475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.885645] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.885839] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.885963] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.886040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.886214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.887149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.887149] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18364875-b9a9-4b62-89e0-3b1c941ee870',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.133854] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.209138] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef in Status: SUCCESS [ 877.209138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.209319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.209427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.209536] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.301975] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: SUCCESS [ 877.302173] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 deletion is rescheduled due to dependency. [ 877.302374] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.393583] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.393583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.393583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.393583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.393583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.393583] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.393583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.393583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.393583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.393583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.393583] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 is going to be deleted. [ 877.425951] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.425951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.425951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.425951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.425951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.425951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.425951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.425951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.425951] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.425951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.425951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.425951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.425951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.425951] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18364875-b9a9-4b62-89e0-3b1c941ee870',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.636931] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.665458] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: SUCCESS [ 877.665458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.665458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.665458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.665458] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.665458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.665458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.665458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.665458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.665458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.665458] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.668103] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 877.675188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.675188] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef in Status: SUCCESS [ 877.675188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.675188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.675188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.675188] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.675188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.675188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.675188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.675188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.675188] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.681422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.681422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.681422] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.681422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.681422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.681422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.681422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.681422] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.685533] env[69656]: INFO networking_nsxv3.common.synchronization [req-95a7067a-a684-4d43-b0f9-307e66b92b92 req-46e5df83-39ae-4b16-bb96-551954b1b21a tempest-ServersV294TestFqdnHostnames-1402798877 tempest-ServersV294TestFqdnHostnames-1402798877-project-member] Enqueued Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGHEST for action security_group_members [ 877.685533] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGHEST for action security_group_members [ 877.685835] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e79ef0da-74c8-48fe-99d7-25b720dd4847 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.685946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.685946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.688740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.688740] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.688740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.688740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.688740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.688740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.688740] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.738681] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.738828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.738980] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.739136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.739247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.739326] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef is going to be deleted. [ 877.788448] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.788768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.788768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.789032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.789032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.789032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.929559] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.929747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.929823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.930154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.930245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.930561] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.930707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.930775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.930946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.931049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.931160] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 already deleted. [ 877.931243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.931348] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18364875-b9a9-4b62-89e0-3b1c941ee870',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.932261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.932452] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.932610] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.932709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.932770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.932904] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.932974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.933598] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18364875-b9a9-4b62-89e0-3b1c941ee870',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.139276] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.139505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.139608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.139910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.140106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.140285] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d is going to be updated. [ 878.171572] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.171656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.171858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.172359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.172720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.182597] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: IN_PROGRESS for 2s [ 878.183316] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.183484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.183484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.183676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.183864] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.184459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.184459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.184459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.184634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.184674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.184948] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.185087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.185163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.185403] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.185556] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.185964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.185964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.185964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.186110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.186159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.186205] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.188514] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.189327] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.189454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.189518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.189708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.189838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.190100] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.190273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.190879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.190879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.190879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.190879] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef is going to be deleted. [ 878.193020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.193020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.193020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.193020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.193020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.193357] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.193521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.193521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.193903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.193903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.193903] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 is going to be updated. [ 878.231254] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.231496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.231496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.231686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.231863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.233758] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.233923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.233965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.234206] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.234316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.234456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.235096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.235319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.235552] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.235677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.235739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.235901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.236029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.236137] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('851ee1e3-ade5-4272-9bc3-8f2d1cca03ef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.251780] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 in Status: IN_PROGRESS for 2s [ 878.436490] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18364875-b9a9-4b62-89e0-3b1c941ee870',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.440870] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.441125] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.441209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.441455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.441546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.441802] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.441912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.441975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.442191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.442327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.442379] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 already deleted. [ 878.442517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.690895] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e938057-3189-4358-8ca5-5e18d05bbddf: rpc.has_security_group_logging(os_id): False [ 878.696272] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.707402] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.707518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.707590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.707945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.707945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.708173] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.708287] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.708570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.708570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.708673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.708776] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.708864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.708921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.709098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.709175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.709448] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.709555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.709618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.709776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.709855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.710362] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf is going to be updated. [ 878.738785] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.738953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.739185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.739435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.739435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.739547] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.739672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.739710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.739874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.739924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.740082] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 851ee1e3-ade5-4272-9bc3-8f2d1cca03ef already deleted. [ 878.740193] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-851ee1e3-ade5-4272-9bc3-8f2d1cca03ef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.767583] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.767736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.767815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.768041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.768300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.783276] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: IN_PROGRESS for 2s [ 878.943505] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18364875-b9a9-4b62-89e0-3b1c941ee870: rpc.has_security_group_logging(os_id): False [ 878.967475] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.967475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.967655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.970919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.970919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.970919] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.970919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.970919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.970919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.970919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.970919] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 is going to be created. [ 878.986991] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/18364875-b9a9-4b62-89e0-3b1c941ee870], does not exist path=[/infra/domains/default/groups/18364875-b9a9-4b62-89e0-3b1c941ee870]."\n}' [ 878.987177] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/18364875-b9a9-4b62-89e0-3b1c941ee870 [ 878.987267] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 879.017610] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.017762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.017940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.018057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.018884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.019203] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.019352] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.019393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.019587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.021048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.021312] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.021425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.021505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.021672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.021746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.021837] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18364875-b9a9-4b62-89e0-3b1c941ee870 is going to be created. [ 879.037362] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/18364875-b9a9-4b62-89e0-3b1c941ee870], does not exist path=[/infra/domains/default/groups/18364875-b9a9-4b62-89e0-3b1c941ee870]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/18364875-b9a9-4b62-89e0-3b1c941ee870 [ 879.037580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18364875-b9a9-4b62-89e0-3b1c941ee870" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.037745] env[69656]: Traceback (most recent call last): [ 879.037806] env[69656]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 879.037806] env[69656]: return func(*args, **kwargs) [ 879.037806] env[69656]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 879.037806] env[69656]: res.raise_for_status() [ 879.037806] env[69656]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 879.037806] env[69656]: raise HTTPError(http_error_msg, response=self) [ 879.037806] env[69656]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/18364875-b9a9-4b62-89e0-3b1c941ee870 [ 879.037806] env[69656]: During handling of the above exception, another exception occurred: [ 879.037806] env[69656]: Traceback (most recent call last): [ 879.037806] env[69656]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 879.037806] env[69656]: listener.cb(fileno) [ 879.037806] env[69656]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 879.037806] env[69656]: result = function(*args, **kwargs) [ 879.037806] env[69656]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 879.037806] env[69656]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 879.037806] env[69656]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 879.037806] env[69656]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 879.037806] env[69656]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 879.037806] env[69656]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 879.037806] env[69656]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 879.037806] env[69656]: res.raise_for_status() [ 879.037806] env[69656]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 879.037806] env[69656]: raise HTTPError(http_error_msg, response=self) [ 879.038695] env[69656]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/18364875-b9a9-4b62-89e0-3b1c941ee870 [ 879.038695] env[69656]: Removing descriptor: 67 [ 879.198176] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.198348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.198415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.198646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.198739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.198841] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 879.254930] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.255104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.255213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.255450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.255616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.264507] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 880.209609] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: SUCCESS [ 880.209609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.262516] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 in Status: SUCCESS [ 880.262658] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 deletion is rescheduled due to dependency. [ 880.262694] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.804573] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: SUCCESS [ 880.805786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.083237] env[69656]: INFO networking_nsxv3.common.synchronization [req-e70e1c01-fda3-40ed-9421-476ee47ab702 req-a875590e-72e8-4c50-8cf0-2093525ea916 tempest-ServersTestMultiNic-506331318 tempest-ServersTestMultiNic-506331318-project-member] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 881.083237] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 881.085457] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.085629] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.085743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.086013] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.086210] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.086316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.086380] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.086558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.086665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.086763] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.275177] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 881.275485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.275578] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.276090] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.276559] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.276559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.276559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.277187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.277187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.277187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.277426] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.277537] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.277605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.277798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.277926] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.278101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.278151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.278341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.279397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.279557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.279691] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.280882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.281235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.281517] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.281656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.281741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.281908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.284308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.284308] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.592470] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.592470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.592470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.592470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.592470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.592470] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.592470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.592470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.592470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.592470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.592470] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be deleted. [ 881.603085] env[69656]: INFO networking_nsxv3.common.synchronization [req-e70e1c01-fda3-40ed-9421-476ee47ab702 req-e02bacf6-c781-4592-8581-35d25b811c18 tempest-ServersTestMultiNic-506331318 tempest-ServersTestMultiNic-506331318-project-member] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 881.603085] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 881.603085] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.603085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.621391] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.624053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.624053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.624053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.624053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.624053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.624053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.624053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.624053] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.624053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.624053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.624053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.624053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.624053] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.787867] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22763ac9-09b1-45ba-b8a9-6df4fc54e141: rpc.has_security_group_logging(os_id): False [ 881.787867] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.807251] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.807750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.807965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.808406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.831044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.831044] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.831044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.831044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.834045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.834045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.834256] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.834423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.834423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.834612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.834673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.834975] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.835147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.835212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.835356] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.835480] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.835637] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 881.901284] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.901525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.901525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.903214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.903214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.917480] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 882.127735] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.127975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.128143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.128489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.128589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.128824] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.129152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.129321] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.129435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.129557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.129632] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c already deleted. [ 882.129768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.141116] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.141637] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-193" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.141637] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-193" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.141877] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-193" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.142203] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.142306] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.142478] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.142670] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.142865] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.143055] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.143355] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.143355] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.143449] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.143522] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.143653] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.143751] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.165428] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.165587] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 882.165644] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.165841] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-193" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.166267] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-8c95292c-3d28-4314-aa33-ed9d6655f13d taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.166463] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-8c95292c-3d28-4314-aa33-ed9d6655f13d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.166580] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-8c95292c-3d28-4314-aa33-ed9d6655f13d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.166921] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-8c95292c-3d28-4314-aa33-ed9d6655f13d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.167138] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c95292c-3d28-4314-aa33-ed9d6655f13d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.292922] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.365800] env[69656]: INFO networking_nsxv3.common.synchronization [req-aae99b25-74e3-47de-9fcb-f6cb53d21c0d req-a4c82574-8c65-4f73-aab2-6ea27cd76fa8 tempest-ServerDiskConfigTestJSON-2110996415 tempest-ServerDiskConfigTestJSON-2110996415-project-member] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 882.366420] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 882.367074] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.367074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.367074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.367237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.368104] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.368104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.368242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.368494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.368545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.368660] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.671266] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.672427] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.672427] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.672427] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.672427] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.672427] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 8c95292c-3d28-4314-aa33-ed9d6655f13d not found, creating... [ 882.672768] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.672768] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.672882] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.673123] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.673410] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.673568] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.673737] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.673864] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.674112] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.674336] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.674496] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 8c95292c-3d28-4314-aa33-ed9d6655f13d is going to be created. [ 882.706163] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.706163] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.706163] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.706163] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.706163] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.706163] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-8c95292c-3d28-4314-aa33-ed9d6655f13d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.799025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.799025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.799025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.799025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.799025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.799025] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 882.851159] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.851355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.851355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.851492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.851632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.862488] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 882.871126] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.871219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.871325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.871520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.892057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.892361] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.892532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.892532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.892719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.892774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.892886] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 882.928411] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.928542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.928542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.928763] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.928904] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.938740] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 883.498508] env[69656]: INFO networking_nsxv3.common.synchronization [req-e70e1c01-fda3-40ed-9421-476ee47ab702 req-894ff4be-a62c-4ff7-8a1a-87fb561ce0b3 service nova] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_rules [ 883.498781] env[69656]: INFO networking_nsxv3.common.synchronization [req-e70e1c01-fda3-40ed-9421-476ee47ab702 req-894ff4be-a62c-4ff7-8a1a-87fb561ce0b3 service nova] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 883.498899] env[69656]: INFO networking_nsxv3.common.synchronization [req-e70e1c01-fda3-40ed-9421-476ee47ab702 req-894ff4be-a62c-4ff7-8a1a-87fb561ce0b3 service nova] Enqueued Resource ID: 8c95292c-3d28-4314-aa33-ed9d6655f13d with Priority: HIGHEST for action port [ 883.499480] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_rules [ 883.499638] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 883.499741] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c95292c-3d28-4314-aa33-ed9d6655f13d with Priority: HIGHEST for action port [ 883.504387] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.504387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.504387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.504387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.504387] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.504387] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.504387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.504387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.504387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.504387] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.504387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.504387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.504387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.504387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.504387] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.507397] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c95292c-3d28-4314-aa33-ed9d6655f13d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.507397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c95292c-3d28-4314-aa33-ed9d6655f13d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.507397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c95292c-3d28-4314-aa33-ed9d6655f13d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.507397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c95292c-3d28-4314-aa33-ed9d6655f13d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.507397] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c95292c-3d28-4314-aa33-ed9d6655f13d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.935754] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 883.935987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.936189] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.936418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.936662] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.012616] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.015140] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.015284] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.015492] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c95292c-3d28-4314-aa33-ed9d6655f13d with status ACTIVE [ 884.020055] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.020055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.020055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.020055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.020055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.020055] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.020055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.020055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.020055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.020055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.020055] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.020055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.020055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.020055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.020055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.020055] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c95292c-3d28-4314-aa33-ed9d6655f13d is going to be updated. [ 884.042316] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.042316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.042316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.042316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.042316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.042316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c95292c-3d28-4314-aa33-ed9d6655f13d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.442976] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.443132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.477878] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-673 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.478225] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-673" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.478309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-673" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.478674] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-673" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.478990] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.479207] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.479356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.479631] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.479816] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.480206] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.480717] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.480717] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.480717] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.480869] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.480869] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.481015] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.497869] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.498125] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 884.498273] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.498454] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-673" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.498761] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-b13f8bc8-c4be-4955-9855-542bd68942d1 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.499065] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-b13f8bc8-c4be-4955-9855-542bd68942d1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.499065] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-b13f8bc8-c4be-4955-9855-542bd68942d1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.499356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-b13f8bc8-c4be-4955-9855-542bd68942d1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.499547] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b13f8bc8-c4be-4955-9855-542bd68942d1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.521099] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.875565] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 884.875799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.875964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.876206] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.876402] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.876520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.876600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.876757] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.876830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.876916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.877013] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.948357] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 884.948591] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b deletion is rescheduled due to dependency. [ 884.948675] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.005700] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.005937] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.006077] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.006410] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.006569] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.006732] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port b13f8bc8-c4be-4955-9855-542bd68942d1 not found, creating... [ 885.007017] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.008333] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.008333] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.008333] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.008333] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.008333] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.008333] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.008333] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.008789] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.008789] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.008789] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: b13f8bc8-c4be-4955-9855-542bd68942d1 is going to be created. [ 885.023827] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.023977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.024051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.024246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.024423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.024423] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be created. [ 885.027186] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.027373] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.027504] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.027743] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.028069] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.028678] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-b13f8bc8-c4be-4955-9855-542bd68942d1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.048274] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.048436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.048504] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.048712] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.048865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.057207] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: UNINITIALIZED for 2s [ 885.379870] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.380081] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.380262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.380396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.380567] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.380669] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.380732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.380874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.380964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.381084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.381251] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.381623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.381623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.381623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.381787] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.381787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.381787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.381949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.381983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.382072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.382161] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.813174] env[69656]: INFO networking_nsxv3.common.synchronization [req-e70e1c01-fda3-40ed-9421-476ee47ab702 req-6de9f2f0-45ea-4bed-b54a-0f5d137fcf2d service nova] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_rules [ 885.813444] env[69656]: INFO networking_nsxv3.common.synchronization [req-e70e1c01-fda3-40ed-9421-476ee47ab702 req-6de9f2f0-45ea-4bed-b54a-0f5d137fcf2d service nova] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 885.813483] env[69656]: INFO networking_nsxv3.common.synchronization [req-e70e1c01-fda3-40ed-9421-476ee47ab702 req-6de9f2f0-45ea-4bed-b54a-0f5d137fcf2d service nova] Enqueued Resource ID: b13f8bc8-c4be-4955-9855-542bd68942d1 with Priority: HIGHEST for action port [ 885.813703] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_rules [ 885.813867] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 885.813922] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b13f8bc8-c4be-4955-9855-542bd68942d1 with Priority: HIGHEST for action port [ 885.816260] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.816370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.816569] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.816654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.816892] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-b13f8bc8-c4be-4955-9855-542bd68942d1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.816961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b13f8bc8-c4be-4955-9855-542bd68942d1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.816996] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b13f8bc8-c4be-4955-9855-542bd68942d1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.817379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b13f8bc8-c4be-4955-9855-542bd68942d1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.817379] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b13f8bc8-c4be-4955-9855-542bd68942d1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.884600] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22763ac9-09b1-45ba-b8a9-6df4fc54e141: rpc.has_security_group_logging(os_id): False [ 885.900576] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.900716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.900786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.900999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.901098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.902921] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.902921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.902921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.902921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.902921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.902921] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.902921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.902921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.902921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.902921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.902921] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.902921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.902921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.902921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.903525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.903525] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 885.958432] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.959166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.959166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.959166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.959166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.976230] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 886.121840] env[69656]: INFO networking_nsxv3.common.synchronization [req-485bba31-f17a-4906-a602-83991fc39d77 req-2c4126bc-439b-4032-acd3-ec672f96a2ed tempest-MultipleCreateTestJSON-62297241 tempest-MultipleCreateTestJSON-62297241-project-member] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 886.122376] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 886.122706] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.122828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.122893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.123685] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.124074] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.124074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.124074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.124292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.124405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.124525] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.327019] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b13f8bc8-c4be-4955-9855-542bd68942d1 with status ACTIVE [ 886.327019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.327019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.327019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.327019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.327019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.327019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.327019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.327019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.327019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.327019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.327596] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.327596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.327596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.327596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.327596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.327596] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b13f8bc8-c4be-4955-9855-542bd68942d1 is going to be updated. [ 886.346556] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.346697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.346756] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.346961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.347109] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.347261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b13f8bc8-c4be-4955-9855-542bd68942d1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.628091] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.628091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.628091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.628091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.628091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.628091] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.628091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.628091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.628091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.628091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.628091] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 already deleted. [ 886.628091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.762501] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-133 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.762731] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.762877] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.763183] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.764036] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.764036] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.764036] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.764036] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.764846] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.765895] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.765895] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.765895] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.765895] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.765895] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 886.765895] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.765895] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.782704] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.782920] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 886.783279] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.783354] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.783673] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-32b55e77-4a3b-4572-836f-3aa876bbf831 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.783927] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-32b55e77-4a3b-4572-836f-3aa876bbf831" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.784085] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-32b55e77-4a3b-4572-836f-3aa876bbf831" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.784526] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-32b55e77-4a3b-4572-836f-3aa876bbf831" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.784624] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32b55e77-4a3b-4572-836f-3aa876bbf831',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.066487] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 887.066791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.067707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.068044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.068335] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.068507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.068610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.068822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.070058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.070218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.070300] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.073516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.073516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.073516] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.073516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.073516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.073516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.073516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.073516] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.293020] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.293020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.293020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.293020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.293020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.293020] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 32b55e77-4a3b-4572-836f-3aa876bbf831 not found, creating... [ 887.293020] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.293020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.293020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.293020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.293020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.293568] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.293568] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.293568] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.293568] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.293568] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.293568] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 32b55e77-4a3b-4572-836f-3aa876bbf831 is going to be created. [ 887.318851] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.319174] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.319308] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.321680] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.321680] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.321680] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-32b55e77-4a3b-4572-836f-3aa876bbf831" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.573823] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.574045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.574203] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.993086] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 887.993366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.080627] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.280022] env[69656]: INFO networking_nsxv3.common.synchronization [None req-c85744e7-7ce9-49ef-95be-169bf147bd23 None None] Enqueued Resource ID: e3f0da81-5bf8-4537-8619-f2c378f4cf62 with Priority: HIGHEST for action port [ 888.280563] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3f0da81-5bf8-4537-8619-f2c378f4cf62 with Priority: HIGHEST for action port [ 888.282402] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3f0da81-5bf8-4537-8619-f2c378f4cf62 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.282402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3f0da81-5bf8-4537-8619-f2c378f4cf62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.282402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3f0da81-5bf8-4537-8619-f2c378f4cf62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.282402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3f0da81-5bf8-4537-8619-f2c378f4cf62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.282402] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3f0da81-5bf8-4537-8619-f2c378f4cf62',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.500497] env[69656]: INFO networking_nsxv3.common.synchronization [req-485bba31-f17a-4906-a602-83991fc39d77 req-ce21bab1-e7a6-4a58-9f14-cdd80fa9bc60 service nova] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_rules [ 888.502235] env[69656]: INFO networking_nsxv3.common.synchronization [req-485bba31-f17a-4906-a602-83991fc39d77 req-ce21bab1-e7a6-4a58-9f14-cdd80fa9bc60 service nova] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 888.502235] env[69656]: INFO networking_nsxv3.common.synchronization [req-485bba31-f17a-4906-a602-83991fc39d77 req-ce21bab1-e7a6-4a58-9f14-cdd80fa9bc60 service nova] Enqueued Resource ID: 32b55e77-4a3b-4572-836f-3aa876bbf831 with Priority: HIGHEST for action port [ 888.502235] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_rules [ 888.502235] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 888.502749] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b55e77-4a3b-4572-836f-3aa876bbf831 with Priority: HIGHEST for action port [ 888.503275] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.503807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.504472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.504472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.504472] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.506265] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.507818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.507818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.507818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.507818] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.507818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.507818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.507818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.507818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.507818] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.512204] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-32b55e77-4a3b-4572-836f-3aa876bbf831 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.512204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32b55e77-4a3b-4572-836f-3aa876bbf831" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.512204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32b55e77-4a3b-4572-836f-3aa876bbf831" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.512204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32b55e77-4a3b-4572-836f-3aa876bbf831" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.512204] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32b55e77-4a3b-4572-836f-3aa876bbf831',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.582731] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.582874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.583302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.583302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.583302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.583634] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be updated. [ 888.679613] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.679893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.680048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.682722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.682722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.691466] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: IN_PROGRESS for 2s [ 888.756335] env[69656]: INFO networking_nsxv3.common.synchronization [req-485bba31-f17a-4906-a602-83991fc39d77 req-eeebb2d7-f145-42ee-b11a-c43070ed049f tempest-MultipleCreateTestJSON-62297241 tempest-MultipleCreateTestJSON-62297241-project-member] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 888.756887] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 888.757152] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.757362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.784250] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3f0da81-5bf8-4537-8619-f2c378f4cf62 [ 888.785542] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.785542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.785542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.785542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.785542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.785542] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3f0da81-5bf8-4537-8619-f2c378f4cf62 already deleted. [ 888.785542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3f0da81-5bf8-4537-8619-f2c378f4cf62" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.016394] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.017896] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.018027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.018183] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32b55e77-4a3b-4572-836f-3aa876bbf831 with status ACTIVE [ 889.018417] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.018528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.018602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.019144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.019144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.019320] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.019393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.019514] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.019564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.019640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.019819] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.019931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.019993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.020136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.020222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.022019] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32b55e77-4a3b-4572-836f-3aa876bbf831 is going to be updated. [ 889.044687] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.044872] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.044919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.045466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.045466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.045466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32b55e77-4a3b-4572-836f-3aa876bbf831" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.193371] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-133 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.193747] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.193834] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.194230] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.194962] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.195293] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.195577] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.196286] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.196507] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.197046] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 889.197046] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 889.197259] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 889.197385] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 889.197554] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 889.197709] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 889.197890] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 889.217720] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 889.217720] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 889.217854] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 889.218103] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-133" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.218455] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.219235] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.219235] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.219235] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.219235] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.525834] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.725172] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.727980] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.727980] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.727980] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.727980] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.727980] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050 not found, creating... [ 889.727980] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.727980] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.727980] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.727980] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.727980] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.728443] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.728443] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.728443] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.729858] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.730157] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.731735] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050 is going to be created. [ 889.754635] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.754635] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.754635] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.754635] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.754635] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.754635] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.025724] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.025882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.026589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.026589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.026589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.026589] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be created. [ 890.052423] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.052423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.052423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.052646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.052698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.063730] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: UNINITIALIZED for 2s [ 890.469205] env[69656]: INFO networking_nsxv3.common.synchronization [req-485bba31-f17a-4906-a602-83991fc39d77 req-11f5dd12-5092-49bc-b8a5-df5016287d08 service nova] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_rules [ 890.469565] env[69656]: INFO networking_nsxv3.common.synchronization [req-485bba31-f17a-4906-a602-83991fc39d77 req-11f5dd12-5092-49bc-b8a5-df5016287d08 service nova] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 890.469654] env[69656]: INFO networking_nsxv3.common.synchronization [req-485bba31-f17a-4906-a602-83991fc39d77 req-11f5dd12-5092-49bc-b8a5-df5016287d08 service nova] Enqueued Resource ID: ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050 with Priority: HIGHEST for action port [ 890.470269] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_rules [ 890.470333] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 890.470452] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050 with Priority: HIGHEST for action port [ 890.470736] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.470860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.474774] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.474936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.475198] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.475314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.475380] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.475737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.475858] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.597632] env[69656]: INFO networking_nsxv3.common.synchronization [None req-cda38b89-1e7a-4bdc-a1ec-f8a130854179 None None] Enqueued Resource ID: f463c62f-45fc-4635-a49a-c230414fb966 with Priority: HIGHEST for action port [ 890.599053] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f463c62f-45fc-4635-a49a-c230414fb966 with Priority: HIGHEST for action port [ 890.600300] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-f463c62f-45fc-4635-a49a-c230414fb966 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.600442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f463c62f-45fc-4635-a49a-c230414fb966" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.600845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f463c62f-45fc-4635-a49a-c230414fb966" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.601271] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f463c62f-45fc-4635-a49a-c230414fb966" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.601680] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f463c62f-45fc-4635-a49a-c230414fb966',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.706344] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 890.706344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.706344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.706567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.706880] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.707094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.707140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.707296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.707380] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.707508] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.707623] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.707713] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.707771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.707908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.710367] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.710581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.710669] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.710890] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.711310] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.711310] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.711310] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.978629] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050 with status ACTIVE [ 890.978857] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.979118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.979118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.979326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.979490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.979974] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.979974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.979974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.980186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.980186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.980396] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.980494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.980553] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.980693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.980766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.980902] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050 is going to be updated. [ 891.006582] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.006758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.006828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.007045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.007187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.007414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef6ea8e9-4f8f-4ee5-81c1-0a3424df9050" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.105452] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f463c62f-45fc-4635-a49a-c230414fb966 [ 891.105967] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.106334] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.106535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.107431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.107431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.107431] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f463c62f-45fc-4635-a49a-c230414fb966 already deleted. [ 891.107431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f463c62f-45fc-4635-a49a-c230414fb966" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.215734] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fcdf0196-2f66-4c44-9bd4-b05de185002c: rpc.has_security_group_logging(os_id): False [ 891.233375] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.233375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.233375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.233375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.233375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.233755] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.233755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.233755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.233755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.233938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.234044] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.234160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.234216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.234365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.234470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.234654] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.234734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.234797] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.234938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.235010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.235105] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be created. [ 891.287526] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.287724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.287724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.288054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.288367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.301743] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: IN_PROGRESS for 2s [ 892.072476] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: SUCCESS [ 892.072796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.072851] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.073075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.073258] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.073381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.073447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.073606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.073688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.073786] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.576079] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.077401] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.317509] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 893.317966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.318451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.319328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.319763] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.580373] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.585264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.585264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.585264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.585264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.585264] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be updated. [ 893.612137] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.612137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.612137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.612137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.612137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.625145] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: IN_PROGRESS for 2s [ 893.815323] env[69656]: INFO networking_nsxv3.common.synchronization [req-7b3cf1fc-ade5-450c-9331-5c1017fa0d50 req-0e52b5ff-bde1-4738-a429-b3bf7c7bdc5e tempest-VolumesAdminNegativeTest-952299599 tempest-VolumesAdminNegativeTest-952299599-project-member] Enqueued Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGHEST for action security_group_members [ 893.815780] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGHEST for action security_group_members [ 893.816890] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-520db785-680d-4180-b916-bfbc19204d31 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.817056] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.817145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.817416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.817598] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.817706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.817993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.818265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.818374] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.818500] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.822351] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.822484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.822628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.822922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.823105] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.823225] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.823284] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.823466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.823529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.823632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.824126] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.205845] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.206283] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-123" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.206283] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-123" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.206526] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-123" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.206802] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.206966] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.207880] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.207880] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.208031] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.208404] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.208752] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.208876] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.208987] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.209168] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.209967] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.209967] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.232465] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.232630] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 894.232778] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.232974] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-123" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.237025] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-05260360-885f-4271-b73a-6c5dbb9463e6 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.237025] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-05260360-885f-4271-b73a-6c5dbb9463e6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.237025] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-05260360-885f-4271-b73a-6c5dbb9463e6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.237025] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-05260360-885f-4271-b73a-6c5dbb9463e6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.237025] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05260360-885f-4271-b73a-6c5dbb9463e6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.321126] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.321126] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.321126] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.321126] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.321389] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.321389] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.321499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.322136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.322136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.322136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.322136] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 520db785-680d-4180-b916-bfbc19204d31 already deleted. [ 894.322136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.327517] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.327653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.327999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.327999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.328188] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.328243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.328304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.328526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.328631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.328631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.328909] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.328909] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.329064] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.329534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.329534] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.329534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.329534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.329741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.329741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.329812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.330220] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.517113] env[69656]: INFO networking_nsxv3.common.synchronization [req-3d6e27cc-83df-45d7-835c-6869189007ad req-d2909345-101a-4e0f-85b1-df66ab4f99fc tempest-ImagesOneServerNegativeTestJSON-384940824 tempest-ImagesOneServerNegativeTestJSON-384940824-project-member] Enqueued Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 894.517611] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 894.517914] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.518057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.518137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.518340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.518492] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.518586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.518641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.518780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.518859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.520586] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.742781] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.743031] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.743213] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.743500] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.743662] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.743821] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 05260360-885f-4271-b73a-6c5dbb9463e6 not found, creating... [ 894.744112] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.744281] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.744404] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.744713] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.744874] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.745227] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.745394] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.745518] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.745730] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.745871] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.746016] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 05260360-885f-4271-b73a-6c5dbb9463e6 is going to be created. [ 894.765517] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.765767] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.766228] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.766576] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.766823] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.767296] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-05260360-885f-4271-b73a-6c5dbb9463e6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.832107] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fcdf0196-2f66-4c44-9bd4-b05de185002c: rpc.has_security_group_logging(os_id): False [ 894.849677] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.849890] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.849942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.850189] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.850344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.850612] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.850723] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.850789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.850951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.851054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.851355] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.851477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.851542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.851693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.851769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.852040] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.852191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.852288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.852443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.852541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.852632] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be updated. [ 894.929185] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.929303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.929351] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.929644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.929826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.951882] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: IN_PROGRESS for 2s [ 895.024478] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.024478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.024478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.024478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.047076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.047350] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.047539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.047584] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.047752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.047889] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.047945] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf is going to be updated. [ 895.079156] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.079271] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.079271] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.079554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.079680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.090449] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: IN_PROGRESS for 2s [ 895.633102] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: SUCCESS [ 895.633410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.633676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.633786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.634056] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.634178] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.634245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.634412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.634487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.634898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.635144] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.636263] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.636500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.636718] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.638062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.638208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.638714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.638714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.638714] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.688214] env[69656]: INFO networking_nsxv3.common.synchronization [req-7b3cf1fc-ade5-450c-9331-5c1017fa0d50 req-02ef3a04-fbab-4f1c-946c-928ed8f16ffa service nova] Enqueued Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGHEST for action security_group_rules [ 895.688214] env[69656]: INFO networking_nsxv3.common.synchronization [req-7b3cf1fc-ade5-450c-9331-5c1017fa0d50 req-02ef3a04-fbab-4f1c-946c-928ed8f16ffa service nova] Enqueued Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGHEST for action security_group_members [ 895.688214] env[69656]: INFO networking_nsxv3.common.synchronization [req-7b3cf1fc-ade5-450c-9331-5c1017fa0d50 req-02ef3a04-fbab-4f1c-946c-928ed8f16ffa service nova] Enqueued Resource ID: 05260360-885f-4271-b73a-6c5dbb9463e6 with Priority: HIGHEST for action port [ 895.688214] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGHEST for action security_group_rules [ 895.688214] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGHEST for action security_group_members [ 895.688214] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05260360-885f-4271-b73a-6c5dbb9463e6 with Priority: HIGHEST for action port [ 895.694940] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-520db785-680d-4180-b916-bfbc19204d31 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.698068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.698068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.698068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.698068] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.698886] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-520db785-680d-4180-b916-bfbc19204d31 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.701566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.701566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.701566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.701566] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.701566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.701566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.701566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.701566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.701566] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.701566] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-05260360-885f-4271-b73a-6c5dbb9463e6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.702078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05260360-885f-4271-b73a-6c5dbb9463e6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.702078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05260360-885f-4271-b73a-6c5dbb9463e6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.702078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05260360-885f-4271-b73a-6c5dbb9463e6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.702078] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05260360-885f-4271-b73a-6c5dbb9463e6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.141769] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.141769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.143689] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.206223] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.207300] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-520db785-680d-4180-b916-bfbc19204d31 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.207447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.207573] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05260360-885f-4271-b73a-6c5dbb9463e6 with status ACTIVE [ 896.207728] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.207863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.208042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.208110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.208204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.208388] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.208503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.208570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.208696] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.208775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.208952] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.214641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.214641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.214641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.214641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.214641] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05260360-885f-4271-b73a-6c5dbb9463e6 is going to be updated. [ 896.234331] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.234331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.234463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.234611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.234766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.234941] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05260360-885f-4271-b73a-6c5dbb9463e6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.647720] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.717292] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.808512] env[69656]: INFO networking_nsxv3.common.synchronization [None req-041899e8-2c47-46b3-a37f-074721da4778 None None] Enqueued Resource ID: 43782ac5-ac63-47f1-be0b-36e1f2ee1371 with Priority: HIGHEST for action port [ 896.809082] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43782ac5-ac63-47f1-be0b-36e1f2ee1371 with Priority: HIGHEST for action port [ 896.812217] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-43782ac5-ac63-47f1-be0b-36e1f2ee1371 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.812217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43782ac5-ac63-47f1-be0b-36e1f2ee1371" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.812217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43782ac5-ac63-47f1-be0b-36e1f2ee1371" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.812217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43782ac5-ac63-47f1-be0b-36e1f2ee1371" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.812217] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43782ac5-ac63-47f1-be0b-36e1f2ee1371',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.970388] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 896.970647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.100394] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: SUCCESS [ 897.100613] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf deletion is rescheduled due to dependency. [ 897.100752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.149241] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.149504] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.150214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.152014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.152181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.152322] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be updated. [ 897.178924] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.179227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.179375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.179722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.180007] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.189432] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: IN_PROGRESS for 2s [ 897.221414] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.221414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.221414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.221414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.221414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.221414] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 520db785-680d-4180-b916-bfbc19204d31 is going to be created. [ 897.242832] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.243264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.243646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.243646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.243725] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.252409] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 520db785-680d-4180-b916-bfbc19204d31 in Status: UNINITIALIZED for 2s [ 897.315894] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43782ac5-ac63-47f1-be0b-36e1f2ee1371 [ 897.316108] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.316246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.316333] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.316548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.316655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.316758] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43782ac5-ac63-47f1-be0b-36e1f2ee1371 already deleted. [ 897.317975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43782ac5-ac63-47f1-be0b-36e1f2ee1371" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.780123] env[69656]: INFO networking_nsxv3.common.synchronization [req-28d69f62-fea8-4435-a2f5-202bada33fed req-485a992d-ce5b-4d26-b850-cf6002f307f8 tempest-ServersTestMultiNic-506331318 tempest-ServersTestMultiNic-506331318-project-member] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 897.780768] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 897.782029] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.782029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.782029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.782029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.782029] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.782029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.782029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.782029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.782800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.782800] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.217016] env[69656]: INFO networking_nsxv3.common.synchronization [req-28d69f62-fea8-4435-a2f5-202bada33fed req-b8a12a28-42ca-41c5-9e77-a75daa6e5a4a tempest-ServersTestMultiNic-506331318 tempest-ServersTestMultiNic-506331318-project-member] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 898.217582] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGHEST for action security_group_members [ 898.217890] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.217992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.285078] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.790697] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.202182] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: SUCCESS [ 899.202590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.202830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.203858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.203858] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.203858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.203858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.203858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.203858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.204177] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.204177] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.204177] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.204309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.204411] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.204560] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.204651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.204707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.204894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.205013] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.205141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.205247] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.261097] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 520db785-680d-4180-b916-bfbc19204d31 in Status: SUCCESS [ 899.261097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.261254] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.261795] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.261795] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.261795] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.261997] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.261997] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.262100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.262210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.262307] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.293199] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.293361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.293421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.293921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.293921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.293921] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be updated. [ 899.312532] env[69656]: INFO networking_nsxv3.common.synchronization [None req-26184741-a96d-41b9-86df-aff04204d3c2 None None] Enqueued Resource ID: fcdabd4e-585f-4206-91ac-4aedf5d4c712 with Priority: HIGHEST for action port [ 899.312532] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdabd4e-585f-4206-91ac-4aedf5d4c712 with Priority: HIGHEST for action port [ 899.312642] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcdabd4e-585f-4206-91ac-4aedf5d4c712 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.313103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcdabd4e-585f-4206-91ac-4aedf5d4c712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.313181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcdabd4e-585f-4206-91ac-4aedf5d4c712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.313571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcdabd4e-585f-4206-91ac-4aedf5d4c712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.313691] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcdabd4e-585f-4206-91ac-4aedf5d4c712',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.317883] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.318018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.318091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.318302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.318455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.326415] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: IN_PROGRESS for 2s [ 899.708529] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11735c24-7aeb-4be5-9e7b-07f4290bc8a6: rpc.has_security_group_logging(os_id): False [ 899.725424] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.725611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.725666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.725856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.725959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.726393] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.726393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.726393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.726550] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.726590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.726774] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.726888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.726950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.727102] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.727184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.727361] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.727468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.727534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.727666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.727753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.727891] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be created. [ 899.766671] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.779751] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.779932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.780017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.780259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.780541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.792343] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: IN_PROGRESS for 2s [ 899.815795] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fcdabd4e-585f-4206-91ac-4aedf5d4c712 [ 899.815795] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.816195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.816195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.816195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.816380] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.816380] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fcdabd4e-585f-4206-91ac-4aedf5d4c712 already deleted. [ 899.816472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcdabd4e-585f-4206-91ac-4aedf5d4c712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.269564] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 520db785-680d-4180-b916-bfbc19204d31: rpc.has_security_group_logging(os_id): False [ 900.288900] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.288900] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.288900] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.288900] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.288900] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.288900] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.289400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.289400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.289400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.289400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.289726] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 520db785-680d-4180-b916-bfbc19204d31 is going to be created. [ 900.373023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.373023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.373023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.373023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.373023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.386541] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 520db785-680d-4180-b916-bfbc19204d31 in Status: IN_PROGRESS for 2s [ 900.695283] env[69656]: INFO networking_nsxv3.common.synchronization [req-e697b30a-d613-4139-ae79-3bca171a96bd req-bb638408-c78b-4979-8b67-68d508b3a051 tempest-MultipleCreateTestJSON-62297241 tempest-MultipleCreateTestJSON-62297241-project-member] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 900.695834] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 900.696149] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.696276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.696344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.696542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.696690] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.696786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.696849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.696992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.697915] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.697958] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.936994] env[69656]: INFO networking_nsxv3.common.synchronization [req-9b85f97b-a3cd-466e-805d-36fa60a2d576 req-76b1e938-167e-41e7-9136-7fc2e519b867 tempest-MultipleCreateTestJSON-62297241 tempest-MultipleCreateTestJSON-62297241-project-member] Enqueued Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 900.938779] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 with Priority: HIGHEST for action security_group_members [ 900.939368] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.939652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.200959] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.336022] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 901.336236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.336405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.336635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.336812] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.336923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.336983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.337139] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.337223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.337315] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.708925] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.808040] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: SUCCESS [ 901.808040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.808040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.808040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.808040] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.841818] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.841920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.841920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.843847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.843847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.843847] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.843847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.843847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.843847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.843847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.843847] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be updated. [ 901.868943] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.868943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.868943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.868943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.868943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.875621] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: IN_PROGRESS for 2s [ 902.211914] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.212241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.212241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.212822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.212822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.212950] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be updated. [ 902.244425] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.244598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.244648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.244860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.244998] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.257461] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: IN_PROGRESS for 2s [ 902.331590] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.331590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.331856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.331962] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.332116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.332254] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be deleted. [ 902.393280] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.393433] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.393506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.393718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.393809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.393932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.408022] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 520db785-680d-4180-b916-bfbc19204d31 in Status: SUCCESS [ 902.408022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.885156] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcdf0196-2f66-4c44-9bd4-b05de185002c in Status: SUCCESS [ 903.885411] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c deletion is rescheduled due to dependency. [ 903.885446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.271654] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 in Status: SUCCESS [ 904.272226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.272226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.272329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.272565] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.272728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.272799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.273015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.273117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.273241] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11735c24-7aeb-4be5-9e7b-07f4290bc8a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.776052] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.777168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.777225] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.777458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.777572] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.780044] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.780044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.780044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.780044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.780044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.780044] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11735c24-7aeb-4be5-9e7b-07f4290bc8a6 is going to be deleted. [ 904.803502] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.803502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.803502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.803502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.803502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.803502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11735c24-7aeb-4be5-9e7b-07f4290bc8a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.941867] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 905.942140] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 907.080585] env[69656]: INFO networking_nsxv3.common.synchronization [None req-0233e806-e200-4d60-84d8-bc8468771178 None None] Enqueued Resource ID: 3d56b0bd-7ca5-4b98-b7a3-aed44300b206 with Priority: HIGHEST for action port [ 907.081118] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d56b0bd-7ca5-4b98-b7a3-aed44300b206 with Priority: HIGHEST for action port [ 907.081524] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d56b0bd-7ca5-4b98-b7a3-aed44300b206 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.081704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d56b0bd-7ca5-4b98-b7a3-aed44300b206" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.081811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d56b0bd-7ca5-4b98-b7a3-aed44300b206" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.082115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d56b0bd-7ca5-4b98-b7a3-aed44300b206" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.082477] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d56b0bd-7ca5-4b98-b7a3-aed44300b206',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.587026] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d56b0bd-7ca5-4b98-b7a3-aed44300b206 [ 907.587357] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.587546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.587619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.587903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.588070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.588178] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d56b0bd-7ca5-4b98-b7a3-aed44300b206 already deleted. [ 907.588320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d56b0bd-7ca5-4b98-b7a3-aed44300b206" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.630945] env[69656]: INFO networking_nsxv3.common.synchronization [req-af0c6457-ba1f-4e49-92b9-d6223b432047 req-c3cf1b80-2912-4d96-b95a-d31d16dc8e4f tempest-ServersTestFqdnHostnames-735452098 tempest-ServersTestFqdnHostnames-735452098-project-member] Enqueued Resource ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf with Priority: HIGHEST for action security_group_members [ 907.631651] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf with Priority: HIGHEST for action security_group_members [ 907.632354] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.632354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.632354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.632543] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.632646] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.632760] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.632822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.633658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.633658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.633658] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.977685] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-72 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.977830] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-72" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.978099] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-72" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.978425] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-72" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.978752] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.979059] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.979321] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.979358] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.979544] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.979808] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 907.980348] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.980772] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.980772] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.980916] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 907.981071] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.981269] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.000922] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.002256] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 908.002498] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.002740] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-72" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.003141] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-ae802c67-fedd-4d18-9455-a2e3bdebc34c taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.003376] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-ae802c67-fedd-4d18-9455-a2e3bdebc34c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.003721] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-ae802c67-fedd-4d18-9455-a2e3bdebc34c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.003882] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-ae802c67-fedd-4d18-9455-a2e3bdebc34c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.004074] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae802c67-fedd-4d18-9455-a2e3bdebc34c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.141226] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.141226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.141226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.141226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.141226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.141226] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.141226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.141226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.141226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.141226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.141226] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf already deleted. [ 908.141226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.507141] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.507397] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.507529] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.507823] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.507986] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.508165] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port ae802c67-fedd-4d18-9455-a2e3bdebc34c not found, creating... [ 908.509108] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.509108] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.509108] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.509108] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.509108] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.509371] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.509533] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.509654] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.509866] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.510015] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.510162] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: ae802c67-fedd-4d18-9455-a2e3bdebc34c is going to be created. [ 908.528693] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.528914] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.529059] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.529346] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.529593] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.529823] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-ae802c67-fedd-4d18-9455-a2e3bdebc34c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.218115] env[69656]: INFO networking_nsxv3.common.synchronization [req-af0c6457-ba1f-4e49-92b9-d6223b432047 req-852151fd-98e9-4954-9a45-8264e720015d service nova] Enqueued Resource ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf with Priority: HIGHEST for action security_group_rules [ 909.218389] env[69656]: INFO networking_nsxv3.common.synchronization [req-af0c6457-ba1f-4e49-92b9-d6223b432047 req-852151fd-98e9-4954-9a45-8264e720015d service nova] Enqueued Resource ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf with Priority: HIGHEST for action security_group_members [ 909.218529] env[69656]: INFO networking_nsxv3.common.synchronization [req-af0c6457-ba1f-4e49-92b9-d6223b432047 req-852151fd-98e9-4954-9a45-8264e720015d service nova] Enqueued Resource ID: ae802c67-fedd-4d18-9455-a2e3bdebc34c with Priority: HIGHEST for action port [ 909.218745] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf with Priority: HIGHEST for action security_group_rules [ 909.218870] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf with Priority: HIGHEST for action security_group_members [ 909.218959] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae802c67-fedd-4d18-9455-a2e3bdebc34c with Priority: HIGHEST for action port [ 909.219515] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.219673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.219706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.220061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.220061] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.221057] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.222341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.222341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.222341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.222341] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.222341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.222341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.222341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.222341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.222341] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.224024] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae802c67-fedd-4d18-9455-a2e3bdebc34c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.224024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae802c67-fedd-4d18-9455-a2e3bdebc34c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.224024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae802c67-fedd-4d18-9455-a2e3bdebc34c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.224024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae802c67-fedd-4d18-9455-a2e3bdebc34c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.224024] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae802c67-fedd-4d18-9455-a2e3bdebc34c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.593334] env[69656]: INFO networking_nsxv3.common.synchronization [None req-2053daa7-e9e4-4ff3-9f89-35d17187fef0 None None] Enqueued Resource ID: ec7366c5-6e6a-45d7-901b-d0ae5654fdc2 with Priority: HIGHEST for action port [ 909.593334] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7366c5-6e6a-45d7-901b-d0ae5654fdc2 with Priority: HIGHEST for action port [ 909.593334] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec7366c5-6e6a-45d7-901b-d0ae5654fdc2 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.593334] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec7366c5-6e6a-45d7-901b-d0ae5654fdc2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.593334] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec7366c5-6e6a-45d7-901b-d0ae5654fdc2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.593573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec7366c5-6e6a-45d7-901b-d0ae5654fdc2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.593737] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec7366c5-6e6a-45d7-901b-d0ae5654fdc2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.724710] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.725728] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.725834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.726203] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae802c67-fedd-4d18-9455-a2e3bdebc34c with status ACTIVE [ 909.726369] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.726479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.726545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.726742] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.726830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.726996] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.727992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.727992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.728164] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.728243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.729237] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.729237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.729237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.729237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.729237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.729237] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae802c67-fedd-4d18-9455-a2e3bdebc34c is going to be updated. [ 909.748730] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.748907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.748999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.749230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.749383] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.749570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae802c67-fedd-4d18-9455-a2e3bdebc34c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.100037] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec7366c5-6e6a-45d7-901b-d0ae5654fdc2 [ 910.100037] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.100229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.100316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.100605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.100605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.100720] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec7366c5-6e6a-45d7-901b-d0ae5654fdc2 already deleted. [ 910.100758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec7366c5-6e6a-45d7-901b-d0ae5654fdc2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.227234] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.305830] env[69656]: INFO networking_nsxv3.common.synchronization [req-0c072e87-0386-4d46-9f7e-ee0609d2fa9d req-06541545-2219-4e86-9552-62c3cb21d364 tempest-FloatingIPsAssociationNegativeTestJSON-148443066 tempest-FloatingIPsAssociationNegativeTestJSON-148443066-project-member] Enqueued Resource ID: be49990d-ddef-4039-b2ad-187913e6ad02 with Priority: HIGHEST for action security_group_members [ 910.306552] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be49990d-ddef-4039-b2ad-187913e6ad02 with Priority: HIGHEST for action security_group_members [ 910.306852] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-be49990d-ddef-4039-b2ad-187913e6ad02 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.306970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.307064] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.307545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.307702] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.307800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.307859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.308016] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.308112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.308471] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be49990d-ddef-4039-b2ad-187913e6ad02',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.617360] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.617552] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-943" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.617675] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-943" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.619041] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-943" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.619425] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.619610] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.619730] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.619970] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.620135] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.620427] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.620551] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.620668] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.620782] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.620899] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.621035] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.621196] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.640391] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.641206] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 910.641206] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.641337] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-943" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.641658] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-a67f2722-526d-478a-9dbc-d1e12c929a3c taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.641826] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-a67f2722-526d-478a-9dbc-d1e12c929a3c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.641953] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-a67f2722-526d-478a-9dbc-d1e12c929a3c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.642304] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-a67f2722-526d-478a-9dbc-d1e12c929a3c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.642452] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a67f2722-526d-478a-9dbc-d1e12c929a3c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.729456] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.729620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.729691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.729906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.729993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.730109] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf is going to be created. [ 910.751737] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.751737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.751737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.751737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.751737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.760721] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf in Status: UNINITIALIZED for 2s [ 910.810872] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.811132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.811212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.811522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.811618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.811875] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.811981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.812053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.812216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.812517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.812517] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be49990d-ddef-4039-b2ad-187913e6ad02 already deleted. [ 910.812517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.145308] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.145685] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.145844] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.146515] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.147180] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.147514] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port a67f2722-526d-478a-9dbc-d1e12c929a3c not found, creating... [ 911.147952] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.148247] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.148450] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.148841] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.149104] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.149573] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.149875] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.150143] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.150612] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.150868] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.151140] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: a67f2722-526d-478a-9dbc-d1e12c929a3c is going to be created. [ 911.180328] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.180672] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.180780] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.181040] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.181318] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.181640] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-a67f2722-526d-478a-9dbc-d1e12c929a3c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.861582] env[69656]: INFO networking_nsxv3.common.synchronization [req-0c072e87-0386-4d46-9f7e-ee0609d2fa9d req-118c4a29-d3cb-4339-bdc1-472bfb1d11dc service nova] Enqueued Resource ID: be49990d-ddef-4039-b2ad-187913e6ad02 with Priority: HIGHEST for action security_group_rules [ 911.861936] env[69656]: INFO networking_nsxv3.common.synchronization [req-0c072e87-0386-4d46-9f7e-ee0609d2fa9d req-118c4a29-d3cb-4339-bdc1-472bfb1d11dc service nova] Enqueued Resource ID: be49990d-ddef-4039-b2ad-187913e6ad02 with Priority: HIGHEST for action security_group_members [ 911.862064] env[69656]: INFO networking_nsxv3.common.synchronization [req-0c072e87-0386-4d46-9f7e-ee0609d2fa9d req-118c4a29-d3cb-4339-bdc1-472bfb1d11dc service nova] Enqueued Resource ID: a67f2722-526d-478a-9dbc-d1e12c929a3c with Priority: HIGHEST for action port [ 911.863288] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be49990d-ddef-4039-b2ad-187913e6ad02 with Priority: HIGHEST for action security_group_rules [ 911.864193] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be49990d-ddef-4039-b2ad-187913e6ad02 with Priority: HIGHEST for action security_group_members [ 911.864335] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a67f2722-526d-478a-9dbc-d1e12c929a3c with Priority: HIGHEST for action port [ 911.864668] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be49990d-ddef-4039-b2ad-187913e6ad02 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.865310] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.865815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.866126] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.866424] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be49990d-ddef-4039-b2ad-187913e6ad02',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.868638] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-be49990d-ddef-4039-b2ad-187913e6ad02 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.869666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.869780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.869983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.871449] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.871449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.871449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.871643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.871687] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.871787] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be49990d-ddef-4039-b2ad-187913e6ad02',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.873431] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-a67f2722-526d-478a-9dbc-d1e12c929a3c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.874449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a67f2722-526d-478a-9dbc-d1e12c929a3c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.874505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a67f2722-526d-478a-9dbc-d1e12c929a3c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.874707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a67f2722-526d-478a-9dbc-d1e12c929a3c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.874808] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a67f2722-526d-478a-9dbc-d1e12c929a3c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.369356] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-be49990d-ddef-4039-b2ad-187913e6ad02 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.369495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.376979] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be49990d-ddef-4039-b2ad-187913e6ad02',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.378196] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a67f2722-526d-478a-9dbc-d1e12c929a3c with status ACTIVE [ 912.378446] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.378740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.378810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.379020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.379113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.379286] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.379384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.379446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.379602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.383023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.383023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.383023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.383023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.383023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.383023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.383023] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a67f2722-526d-478a-9dbc-d1e12c929a3c is going to be updated. [ 912.411396] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.411565] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.411633] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.412955] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.413142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.413272] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a67f2722-526d-478a-9dbc-d1e12c929a3c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.769934] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf in Status: SUCCESS [ 912.770194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.770524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.770764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.770976] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.771116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.771186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.771391] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.771640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.771640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.771710] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.882969] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be49990d-ddef-4039-b2ad-187913e6ad02',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.200702] env[69656]: INFO networking_nsxv3.common.synchronization [req-bbef195a-0b0d-4557-92fb-f9dc735079bf req-9374ab45-8eab-4035-9b58-aec7a4cfda56 tempest-ServerPasswordTestJSON-1124507400 tempest-ServerPasswordTestJSON-1124507400-project-member] Enqueued Resource ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 with Priority: HIGHEST for action security_group_members [ 913.201257] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 with Priority: HIGHEST for action security_group_members [ 913.201583] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.201709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.201777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.202816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.203023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.203601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.203827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.204078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.204175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.204271] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35bc1ec-d02e-41f7-b05b-c27e0d977c43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.273686] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.387580] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.387580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.387580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.387580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.387897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.387897] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be49990d-ddef-4039-b2ad-187913e6ad02 is going to be created. [ 913.413783] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.413926] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.414011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.414254] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.414416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.427413] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be49990d-ddef-4039-b2ad-187913e6ad02 in Status: UNINITIALIZED for 2s [ 913.709065] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.709065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.709065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.709065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.709065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.709065] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.709065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.709065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.709065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.709065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.709065] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 already deleted. [ 913.709065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.780968] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf: rpc.has_security_group_logging(os_id): False [ 913.799646] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.799791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.800456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.804360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.804488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.804788] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.804932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.804994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.805196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.805281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.805377] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf is going to be created. [ 913.810671] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-905 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.810926] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-905" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.812181] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-905" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.812181] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-905" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.812181] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.812181] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.812181] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.812490] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.812721] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.812993] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.813201] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.813370] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.813559] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.813743] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.813907] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.814118] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.838330] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.838404] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 913.838843] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.838843] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-905" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.839299] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-6eb248a8-dfb3-42fd-b123-6b433ed4f767 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.839865] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-6eb248a8-dfb3-42fd-b123-6b433ed4f767" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.839865] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-6eb248a8-dfb3-42fd-b123-6b433ed4f767" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.840029] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-6eb248a8-dfb3-42fd-b123-6b433ed4f767" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.840249] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb248a8-dfb3-42fd-b123-6b433ed4f767',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.878443] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.878604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.879418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.879418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.879418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.894982] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf in Status: IN_PROGRESS for 2s [ 914.343753] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.344180] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.344407] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.344808] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.345064] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.345311] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 6eb248a8-dfb3-42fd-b123-6b433ed4f767 not found, creating... [ 914.345753] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.345951] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.346091] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.346379] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.346532] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.346950] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.347168] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.347289] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.347503] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.347641] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.347832] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 6eb248a8-dfb3-42fd-b123-6b433ed4f767 is going to be created. [ 914.367986] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.367986] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.367986] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.368329] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.368915] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.368997] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-6eb248a8-dfb3-42fd-b123-6b433ed4f767" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.438371] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be49990d-ddef-4039-b2ad-187913e6ad02 in Status: SUCCESS [ 915.438702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.438775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.439016] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.439213] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.439346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.439393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.439557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.439654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.439743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.439837] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be49990d-ddef-4039-b2ad-187913e6ad02',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.523873] env[69656]: INFO networking_nsxv3.common.synchronization [req-bbef195a-0b0d-4557-92fb-f9dc735079bf req-e4624cfc-f4cf-4a59-a1bb-9762a56d97e0 service nova] Enqueued Resource ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 with Priority: HIGHEST for action security_group_rules [ 915.524065] env[69656]: INFO networking_nsxv3.common.synchronization [req-bbef195a-0b0d-4557-92fb-f9dc735079bf req-e4624cfc-f4cf-4a59-a1bb-9762a56d97e0 service nova] Enqueued Resource ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 with Priority: HIGHEST for action security_group_members [ 915.524205] env[69656]: INFO networking_nsxv3.common.synchronization [req-bbef195a-0b0d-4557-92fb-f9dc735079bf req-e4624cfc-f4cf-4a59-a1bb-9762a56d97e0 service nova] Enqueued Resource ID: 6eb248a8-dfb3-42fd-b123-6b433ed4f767 with Priority: HIGHEST for action port [ 915.524444] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 with Priority: HIGHEST for action security_group_rules [ 915.524569] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 with Priority: HIGHEST for action security_group_members [ 915.524659] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb248a8-dfb3-42fd-b123-6b433ed4f767 with Priority: HIGHEST for action port [ 915.526301] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35bc1ec-d02e-41f7-b05b-c27e0d977c43 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.526301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.526301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.526301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.527661] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35bc1ec-d02e-41f7-b05b-c27e0d977c43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.528680] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.528912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.529075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.529432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.530222] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.530486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.530911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.532025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.532025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.532025] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35bc1ec-d02e-41f7-b05b-c27e0d977c43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.532500] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eb248a8-dfb3-42fd-b123-6b433ed4f767 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.532783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eb248a8-dfb3-42fd-b123-6b433ed4f767" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.533512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eb248a8-dfb3-42fd-b123-6b433ed4f767" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.534406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eb248a8-dfb3-42fd-b123-6b433ed4f767" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.535111] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb248a8-dfb3-42fd-b123-6b433ed4f767',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.910154] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf in Status: SUCCESS [ 915.910364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.942131] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-be49990d-ddef-4039-b2ad-187913e6ad02 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.942298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.942377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.942571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.942740] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.942856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.942915] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.943057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.943144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.943229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.943421] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-be49990d-ddef-4039-b2ad-187913e6ad02 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.943585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.943634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.943744] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.943880] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.943972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.944041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.944179] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.944251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.944328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.944414] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be49990d-ddef-4039-b2ad-187913e6ad02',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.036524] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c35bc1ec-d02e-41f7-b05b-c27e0d977c43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.038161] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.038324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.038523] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6eb248a8-dfb3-42fd-b123-6b433ed4f767 with status ACTIVE [ 916.038714] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.039093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.039093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.039295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.039481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.039745] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.039920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.040027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.040270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.040530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.040793] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.041015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.041517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.041517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.041517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.042349] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6eb248a8-dfb3-42fd-b123-6b433ed4f767 is going to be updated. [ 916.064863] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.064863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.064863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.065124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.065260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.065470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eb248a8-dfb3-42fd-b123-6b433ed4f767" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.070873] env[69656]: INFO networking_nsxv3.common.synchronization [req-f6e84b02-8c66-41b6-81f9-d54ef087ecc8 req-a49f44fa-26cf-468f-a372-ad382fc74187 tempest-ImagesTestJSON-514277302 tempest-ImagesTestJSON-514277302-project-member] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 916.071522] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 916.071850] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.071991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.072051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.072283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.072423] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.072529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.072589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.072770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.072820] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.072914] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.447027] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be49990d-ddef-4039-b2ad-187913e6ad02: rpc.has_security_group_logging(os_id): False [ 916.465228] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.465383] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.465457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.465687] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.465784] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.465977] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.466137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.466203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.466366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.466445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.466651] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.466745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.466805] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.466945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.467030] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.467215] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.467309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.467371] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.468615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.468615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.468615] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be49990d-ddef-4039-b2ad-187913e6ad02 is going to be created. [ 916.526212] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.526212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.526212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.526212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.526212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.536546] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be49990d-ddef-4039-b2ad-187913e6ad02 in Status: IN_PROGRESS for 2s [ 916.544432] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c35bc1ec-d02e-41f7-b05b-c27e0d977c43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.575966] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.576182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.576261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.576498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.612781] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.613060] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.613174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.613245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.613447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.613521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.613613] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 916.637417] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.637625] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.637794] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.638109] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.638378] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.638547] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.638670] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.638879] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.639036] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.639252] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.639370] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.639487] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.639599] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.639711] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.639819] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.639954] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.657818] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.657986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.658058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.658256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.658396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.665259] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.665615] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 916.665615] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.665880] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.665989] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-ab3955a0-8995-4a5a-b7b1-cb2c4f153c52 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.666184] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-ab3955a0-8995-4a5a-b7b1-cb2c4f153c52" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.666307] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-ab3955a0-8995-4a5a-b7b1-cb2c4f153c52" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.666638] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-ab3955a0-8995-4a5a-b7b1-cb2c4f153c52" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.666794] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab3955a0-8995-4a5a-b7b1-cb2c4f153c52',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.668177] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 917.048166] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.048338] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.048395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.048614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.048707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.048806] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 is going to be created. [ 917.072960] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.073133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.073189] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.073398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.073568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.082738] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 in Status: UNINITIALIZED for 2s [ 917.170112] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.170412] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.170532] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.170853] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.171036] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.171210] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port ab3955a0-8995-4a5a-b7b1-cb2c4f153c52 not found, creating... [ 917.171525] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.171690] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.171813] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.172062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.172208] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.172523] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.172692] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.172809] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.173046] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.173192] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.173346] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: ab3955a0-8995-4a5a-b7b1-cb2c4f153c52 is going to be created. [ 917.215006] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.215267] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.215401] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.215698] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.215933] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.216199] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-ab3955a0-8995-4a5a-b7b1-cb2c4f153c52" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.147532] env[69656]: INFO networking_nsxv3.common.synchronization [req-f6e84b02-8c66-41b6-81f9-d54ef087ecc8 req-3d178734-2118-4132-b7e0-f0e2d805c93e service nova] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_rules [ 918.147999] env[69656]: INFO networking_nsxv3.common.synchronization [req-f6e84b02-8c66-41b6-81f9-d54ef087ecc8 req-3d178734-2118-4132-b7e0-f0e2d805c93e service nova] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 918.147999] env[69656]: INFO networking_nsxv3.common.synchronization [req-f6e84b02-8c66-41b6-81f9-d54ef087ecc8 req-3d178734-2118-4132-b7e0-f0e2d805c93e service nova] Enqueued Resource ID: ab3955a0-8995-4a5a-b7b1-cb2c4f153c52 with Priority: HIGHEST for action port [ 918.148594] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_rules [ 918.148745] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 918.152855] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3955a0-8995-4a5a-b7b1-cb2c4f153c52 with Priority: HIGHEST for action port [ 918.153259] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.154319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.154319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.154319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.154319] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.155054] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.155188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.155669] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab3955a0-8995-4a5a-b7b1-cb2c4f153c52 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.155805] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab3955a0-8995-4a5a-b7b1-cb2c4f153c52" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.156619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab3955a0-8995-4a5a-b7b1-cb2c4f153c52" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.157777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab3955a0-8995-4a5a-b7b1-cb2c4f153c52" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.157777] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab3955a0-8995-4a5a-b7b1-cb2c4f153c52',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.548391] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be49990d-ddef-4039-b2ad-187913e6ad02 in Status: SUCCESS [ 918.548655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.662111] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.662261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.662467] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab3955a0-8995-4a5a-b7b1-cb2c4f153c52 with status ACTIVE [ 918.662640] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.662844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.662844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.663071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.663159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.663334] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.663434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.663500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.663656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.663730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.663911] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.664037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.664081] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.664221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.664299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.664391] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab3955a0-8995-4a5a-b7b1-cb2c4f153c52 is going to be updated. [ 918.685199] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 918.685199] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e deletion is rescheduled due to dependency. [ 918.685199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.685293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.685631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.685668] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.685806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.685838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.685984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.686084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.686179] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.714585] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.714585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.714796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.715141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.715925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.715925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab3955a0-8995-4a5a-b7b1-cb2c4f153c52" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.092414] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 in Status: SUCCESS [ 919.092890] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.093074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.093296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.093487] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.093677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.093677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.093894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.093894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.093987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.094148] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c35bc1ec-d02e-41f7-b05b-c27e0d977c43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.189085] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.597708] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.597708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.597708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.597936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.598075] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.598206] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.598257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.598455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.598511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.598568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.598719] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.598801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.598884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.598994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.599168] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.599341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.599341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.599468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.599530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.599615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.599705] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c35bc1ec-d02e-41f7-b05b-c27e0d977c43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.691876] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.101635] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c35bc1ec-d02e-41f7-b05b-c27e0d977c43: rpc.has_security_group_logging(os_id): False [ 920.121943] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.122134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.122225] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.122506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.122568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.122876] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.122998] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.123086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.123301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.123368] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.123570] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.123682] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.123752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.123929] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.124171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.124376] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.124477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.124559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.124720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.124881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.124938] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 is going to be created. [ 920.182490] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.182718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.182718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.183518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.183518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.194828] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.194828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.195297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.195297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.195297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.195297] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 920.197215] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 in Status: IN_PROGRESS for 2s [ 920.229280] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.229424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.229494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.229712] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.229888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.239166] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 922.210707] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 in Status: SUCCESS [ 922.213113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.253368] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 922.253368] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.253368] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.254534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.254534] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.254534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.254534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.254534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.254822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.254854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.255593] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.757882] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.758087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.758131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.758364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.758557] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.758666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.758730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.758891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.758982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.759095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.759242] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.759333] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.759393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.759537] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.759670] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.759761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.759820] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.759953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.760038] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.760122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.760210] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.157492] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 923.157492] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 923.262873] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a714e7c-1123-47f3-81e4-70f097603f3e: rpc.has_security_group_logging(os_id): False [ 923.283746] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.283746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.283746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.283746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.283746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.283746] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.283746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.283746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.283746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.283746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.283746] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.283746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.283746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.283746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.283746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.284336] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.284336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.284336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.284336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.284336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.284336] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 923.343323] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.343323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.343323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.343323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.343323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.354980] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 925.369730] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 925.369942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.635826] env[69656]: INFO networking_nsxv3.common.synchronization [req-c16fd73a-1cba-4f9f-8ebf-8e6b9ff57eb5 req-f99583b2-3d4f-4a5e-b13f-6682983667d9 tempest-ServerPasswordTestJSON-1124507400 tempest-ServerPasswordTestJSON-1124507400-project-member] Enqueued Resource ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 with Priority: HIGHEST for action security_group_members [ 925.636964] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 with Priority: HIGHEST for action security_group_members [ 925.636964] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.636964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.636964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.639416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.639639] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.640135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.640293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.640549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.640673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.640794] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35bc1ec-d02e-41f7-b05b-c27e0d977c43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.143964] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.144050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.144236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.144345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.144449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.144644] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.144743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.144802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.144952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.145044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.145131] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 is going to be updated. [ 926.170460] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.170632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.170632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.171547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.171547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.181067] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 in Status: IN_PROGRESS for 2s [ 926.493264] env[69656]: INFO networking_nsxv3.common.synchronization [req-5893380c-c188-4920-9651-9d03b012e39f req-573bddd4-1c60-475f-8675-6add730f57e5 tempest-ListServerFiltersTestJSON-1060652857 tempest-ListServerFiltersTestJSON-1060652857-project-member] Enqueued Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 926.493264] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 926.493264] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.493264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.493264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.493264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.493264] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.493264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.493264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.494596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.494786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.494960] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.610994] env[69656]: INFO networking_nsxv3.common.synchronization [req-aa4ab1a6-9f95-4020-96cf-150d2e8aa606 req-12ea7539-3b40-4086-b5f9-dedb600b9454 tempest-ServersAdminTestJSON-1828746712 tempest-ServersAdminTestJSON-1828746712-project-member] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 926.611424] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 926.611798] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.614567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.614567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.614567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.614567] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.614567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.614567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.614567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.614567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.614567] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.930099] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.930099] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.930099] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.930099] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.930099] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.930099] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.930099] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.930874] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.931201] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.931586] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.931862] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 926.932133] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 926.932395] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 926.934080] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.934080] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 926.934080] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 926.953416] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 926.953416] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 926.953416] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 926.953416] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-470" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.953416] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-2bfb7a8b-9d28-402b-80a7-9b541415571b taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.953416] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-2bfb7a8b-9d28-402b-80a7-9b541415571b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.953416] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-2bfb7a8b-9d28-402b-80a7-9b541415571b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.953416] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-2bfb7a8b-9d28-402b-80a7-9b541415571b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.953416] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bfb7a8b-9d28-402b-80a7-9b541415571b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.998218] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.116366] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.455060] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.455287] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.455421] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.455713] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.455869] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.456038] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 2bfb7a8b-9d28-402b-80a7-9b541415571b not found, creating... [ 927.456318] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.456486] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.456609] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.456834] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.456977] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.457302] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.457426] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.457552] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.457789] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.457945] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.458104] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 2bfb7a8b-9d28-402b-80a7-9b541415571b is going to be created. [ 927.479432] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.479680] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.479835] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.480168] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.480409] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.480730] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-2bfb7a8b-9d28-402b-80a7-9b541415571b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.501440] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.622538] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.004041] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.004172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.004245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.004509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.004563] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.004646] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d is going to be updated. [ 928.038088] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.038251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.038312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.038519] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.038657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.049044] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: IN_PROGRESS for 2s [ 928.127046] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.127046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.127046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.127046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.127046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.127046] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be updated. [ 928.159415] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.159415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.159415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.159415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.159415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.173416] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 928.191803] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 in Status: SUCCESS [ 928.192108] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 deletion is rescheduled due to dependency. [ 928.192235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.220036] env[69656]: INFO networking_nsxv3.common.synchronization [req-aa4ab1a6-9f95-4020-96cf-150d2e8aa606 req-8cf79994-62c4-45a5-8deb-8b91c5d824d6 service nova] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_rules [ 928.220036] env[69656]: INFO networking_nsxv3.common.synchronization [req-aa4ab1a6-9f95-4020-96cf-150d2e8aa606 req-8cf79994-62c4-45a5-8deb-8b91c5d824d6 service nova] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 928.220036] env[69656]: INFO networking_nsxv3.common.synchronization [req-aa4ab1a6-9f95-4020-96cf-150d2e8aa606 req-8cf79994-62c4-45a5-8deb-8b91c5d824d6 service nova] Enqueued Resource ID: 2bfb7a8b-9d28-402b-80a7-9b541415571b with Priority: HIGHEST for action port [ 928.220036] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_rules [ 928.220036] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 928.220036] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bfb7a8b-9d28-402b-80a7-9b541415571b with Priority: HIGHEST for action port [ 928.220036] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.220698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.220872] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.221185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.221460] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.223418] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.223732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.224086] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bfb7a8b-9d28-402b-80a7-9b541415571b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.224340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bfb7a8b-9d28-402b-80a7-9b541415571b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.224483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bfb7a8b-9d28-402b-80a7-9b541415571b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.225493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bfb7a8b-9d28-402b-80a7-9b541415571b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.225493] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bfb7a8b-9d28-402b-80a7-9b541415571b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.730020] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2bfb7a8b-9d28-402b-80a7-9b541415571b with status ACTIVE [ 928.730020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.730020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.730020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.730020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.730020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.730020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.730020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.730020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.730020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.730020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.730020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.730020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.730020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.730020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.730020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.730020] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2bfb7a8b-9d28-402b-80a7-9b541415571b is going to be updated. [ 928.731234] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.731545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.751762] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.751762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.751762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.751762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.751762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.751762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bfb7a8b-9d28-402b-80a7-9b541415571b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.059282] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: SUCCESS [ 930.060217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.098217] env[69656]: INFO networking_nsxv3.common.synchronization [req-9b6fdd54-69de-407f-b1c5-c34e4eeea371 req-91257d2e-b97b-47ed-adda-443ab00285c7 tempest-FloatingIPsAssociationNegativeTestJSON-148443066 tempest-FloatingIPsAssociationNegativeTestJSON-148443066-project-member] Enqueued Resource ID: be49990d-ddef-4039-b2ad-187913e6ad02 with Priority: HIGHEST for action security_group_members [ 930.098217] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be49990d-ddef-4039-b2ad-187913e6ad02 with Priority: HIGHEST for action security_group_members [ 930.098217] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-be49990d-ddef-4039-b2ad-187913e6ad02 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.098217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.098217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.098217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.098217] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.098217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.098217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.098747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.098919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.099093] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be49990d-ddef-4039-b2ad-187913e6ad02',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.144434] env[69656]: INFO networking_nsxv3.common.synchronization [req-b0e318ef-7b26-454c-8084-8f535baca6c1 req-92ef5d87-e349-4a1a-bbd5-609d41430a06 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_members [ 930.144612] env[69656]: INFO networking_nsxv3.common.synchronization [req-b0e318ef-7b26-454c-8084-8f535baca6c1 req-92ef5d87-e349-4a1a-bbd5-609d41430a06 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 753a0574-7bcf-4133-85db-b811b57f750a with Priority: HIGHEST for action security_group_members [ 930.144751] env[69656]: INFO networking_nsxv3.common.synchronization [req-b0e318ef-7b26-454c-8084-8f535baca6c1 req-92ef5d87-e349-4a1a-bbd5-609d41430a06 tempest-SecurityGroupsTestJSON-1353933590 tempest-SecurityGroupsTestJSON-1353933590-project-member] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 930.146283] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGHEST for action security_group_members [ 930.146283] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 753a0574-7bcf-4133-85db-b811b57f750a with Priority: HIGHEST for action security_group_members [ 930.146283] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGHEST for action security_group_members [ 930.146459] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-037b783b-a9e4-4669-8461-2452a42615e1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.146459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.146567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.147149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.147149] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.147149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.147149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.147149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.147379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.147379] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.148232] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-753a0574-7bcf-4133-85db-b811b57f750a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.148326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.148548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.148611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.148697] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.148785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.148843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.148975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.151026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.151026] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.151026] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.151026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.151026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.151026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.151026] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.151026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.151026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.151026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.151479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.151479] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.183049] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 930.183049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.183780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.183780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.184352] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.184352] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.184469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.184840] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.185129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.185248] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.605020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.605020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.605020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.605020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.605020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.605020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.605020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.605020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.605020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.605020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.605020] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be49990d-ddef-4039-b2ad-187913e6ad02 is going to be updated. [ 930.638375] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.638375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.638375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.638375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.638375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.645838] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be49990d-ddef-4039-b2ad-187913e6ad02 in Status: IN_PROGRESS for 2s [ 930.654984] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.654984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.654984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.654984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.654984] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.654984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.654984] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.654984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.669817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.670371] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.670693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.670883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.671201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.671414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.671656] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037b783b-a9e4-4669-8461-2452a42615e1 is going to be updated. [ 930.672710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.673044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.673256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.673581] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.673848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.674041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.677018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.677018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.677018] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be updated. [ 930.677018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.677018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.691168] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.704159] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.705094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.705094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.705094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.705094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.706596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.706819] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.706927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.706995] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.707406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.707547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.707684] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 753a0574-7bcf-4133-85db-b811b57f750a is going to be updated. [ 930.709691] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.710428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.710782] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.711015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.711199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.724522] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: IN_PROGRESS for 2s [ 930.726835] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: IN_PROGRESS for 2s [ 930.740695] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.740972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.740972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.741139] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.741228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.751067] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 753a0574-7bcf-4133-85db-b811b57f750a in Status: IN_PROGRESS for 2s [ 931.193241] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.696546] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.696712] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.696786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.697067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.697183] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.697286] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be updated. [ 931.725712] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.726659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.726659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.726659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.726659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.736748] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 932.226885] env[69656]: INFO networking_nsxv3.common.synchronization [req-efde10ac-9046-4288-bae8-cf61007089cb req-05e08132-9a66-4233-87ad-22d4aad9f242 tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_members [ 932.226885] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_members [ 932.226885] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.226885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.226885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.226885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.226885] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.226885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.226885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.227790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.227790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.227790] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.656550] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be49990d-ddef-4039-b2ad-187913e6ad02 in Status: SUCCESS [ 932.656731] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be49990d-ddef-4039-b2ad-187913e6ad02 deletion is rescheduled due to dependency. [ 932.656840] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.729864] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.730022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.730096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.730307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.730412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.730618] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.730720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.730783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.730935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.731023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.731111] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b already deleted. [ 932.731196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.734070] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.734302] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.734392] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.734615] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.734873] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.735049] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.737266] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.737266] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.737266] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.737266] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 932.737266] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.737266] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.737266] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.737266] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 932.737266] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.737595] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.740585] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 in Status: SUCCESS [ 932.740813] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 deletion is rescheduled due to dependency. [ 932.740975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.741751] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 037b783b-a9e4-4669-8461-2452a42615e1 in Status: SUCCESS [ 932.741965] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 037b783b-a9e4-4669-8461-2452a42615e1 deletion is rescheduled due to dependency. [ 932.742093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.765274] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 753a0574-7bcf-4133-85db-b811b57f750a in Status: SUCCESS [ 932.765274] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 753a0574-7bcf-4133-85db-b811b57f750a deletion is rescheduled due to dependency. [ 932.765274] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.765274] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.765274] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 932.765274] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.765274] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.765274] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-d7a50a53-fac1-4ddf-9946-1c1999418dc8 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.766376] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-d7a50a53-fac1-4ddf-9946-1c1999418dc8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.767597] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-d7a50a53-fac1-4ddf-9946-1c1999418dc8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.768390] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-d7a50a53-fac1-4ddf-9946-1c1999418dc8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.769856] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7a50a53-fac1-4ddf-9946-1c1999418dc8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.271804] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.272134] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.272303] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.275243] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.275243] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.275243] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port d7a50a53-fac1-4ddf-9946-1c1999418dc8 not found, creating... [ 933.275243] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.275243] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.275243] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.275243] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.275243] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.275243] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.275243] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.275874] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.275874] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.275874] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.275874] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: d7a50a53-fac1-4ddf-9946-1c1999418dc8 is going to be created. [ 933.297484] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.297732] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.297865] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.298194] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.298440] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.298733] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-d7a50a53-fac1-4ddf-9946-1c1999418dc8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.754438] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 933.754438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.754438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.754438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.754438] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.754438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.754438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.754438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.754438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.754438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.754438] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.225493] env[69656]: INFO networking_nsxv3.common.synchronization [req-efde10ac-9046-4288-bae8-cf61007089cb req-676432d5-be16-475f-96da-3a9e10e865ee service nova] Enqueued Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_rules [ 934.225840] env[69656]: INFO networking_nsxv3.common.synchronization [req-efde10ac-9046-4288-bae8-cf61007089cb req-676432d5-be16-475f-96da-3a9e10e865ee service nova] Enqueued Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_members [ 934.226070] env[69656]: INFO networking_nsxv3.common.synchronization [req-efde10ac-9046-4288-bae8-cf61007089cb req-676432d5-be16-475f-96da-3a9e10e865ee service nova] Enqueued Resource ID: d7a50a53-fac1-4ddf-9946-1c1999418dc8 with Priority: HIGHEST for action port [ 934.226351] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_rules [ 934.226532] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_members [ 934.226654] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7a50a53-fac1-4ddf-9946-1c1999418dc8 with Priority: HIGHEST for action port [ 934.227296] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.227442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.227534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.227809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.227983] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.229689] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.229801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.230027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.230027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.230180] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.230274] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.230601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.234913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.234913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.234913] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.235292] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7a50a53-fac1-4ddf-9946-1c1999418dc8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.235292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7a50a53-fac1-4ddf-9946-1c1999418dc8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.235405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7a50a53-fac1-4ddf-9946-1c1999418dc8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.235621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7a50a53-fac1-4ddf-9946-1c1999418dc8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.235621] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7a50a53-fac1-4ddf-9946-1c1999418dc8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.256815] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.256932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.257011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.257324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.257499] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.257603] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.258954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.259153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.259248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.259342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.259498] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.259597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.259661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.259802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.259960] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.260043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.260104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.260241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.260319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.260407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.260519] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.615104] env[69656]: INFO networking_nsxv3.common.synchronization [None req-a1d3872f-48e1-4500-a4b1-8880efee70a8 None None] Enqueued Resource ID: 1ec4882d-c100-4c15-9867-1978b3ba2235 with Priority: HIGHEST for action port [ 934.615104] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ec4882d-c100-4c15-9867-1978b3ba2235 with Priority: HIGHEST for action port [ 934.615104] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ec4882d-c100-4c15-9867-1978b3ba2235 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.615104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ec4882d-c100-4c15-9867-1978b3ba2235" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.615596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ec4882d-c100-4c15-9867-1978b3ba2235" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.615596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ec4882d-c100-4c15-9867-1978b3ba2235" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.615596] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ec4882d-c100-4c15-9867-1978b3ba2235',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.737084] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.740043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.740403] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.743138] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7a50a53-fac1-4ddf-9946-1c1999418dc8 with status ACTIVE [ 934.743138] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.743138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.743138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.743138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.743138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.743138] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.743138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.743138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.743138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.743138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.743138] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.743138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.743138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.748824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.748824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.748824] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7a50a53-fac1-4ddf-9946-1c1999418dc8 is going to be updated. [ 934.767185] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.767617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.767681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.768260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.768260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.768446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7a50a53-fac1-4ddf-9946-1c1999418dc8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.769089] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d9740de-f67c-4fbd-a249-44afc4caaef1: rpc.has_security_group_logging(os_id): False [ 934.786150] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.786150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.786150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.786150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.804624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.805020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.805227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.805307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.805508] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.805590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.805794] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.805889] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.805948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.806100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.806169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.806341] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.806426] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.806482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.806614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.806679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.806757] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be updated. [ 934.881682] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.881800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.881839] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.882242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.882242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.900686] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 935.118017] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ec4882d-c100-4c15-9867-1978b3ba2235 [ 935.118275] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.118416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.118489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.118750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.118847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.119395] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ec4882d-c100-4c15-9867-1978b3ba2235 already deleted. [ 935.119395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ec4882d-c100-4c15-9867-1978b3ba2235" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.248186] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.752829] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.753144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.753144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.754631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.754631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.754631] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b is going to be created. [ 935.777211] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.777377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.777566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.777751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.778505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.788556] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: UNINITIALIZED for 2s [ 936.915707] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 936.915707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.990891] env[69656]: INFO networking_nsxv3.common.synchronization [None req-3402bbb6-644b-4d48-8dfc-1b9cad3a9b8d None None] Enqueued Resource ID: e78cc116-f222-4a70-a253-aeffffaf4e00 with Priority: HIGHEST for action port [ 936.990891] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e78cc116-f222-4a70-a253-aeffffaf4e00 with Priority: HIGHEST for action port [ 936.990891] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e78cc116-f222-4a70-a253-aeffffaf4e00 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.990891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e78cc116-f222-4a70-a253-aeffffaf4e00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.990891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e78cc116-f222-4a70-a253-aeffffaf4e00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.990891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e78cc116-f222-4a70-a253-aeffffaf4e00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.990891] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e78cc116-f222-4a70-a253-aeffffaf4e00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.492933] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e78cc116-f222-4a70-a253-aeffffaf4e00 [ 937.493194] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.493329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.493397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.493680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.493773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.493870] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e78cc116-f222-4a70-a253-aeffffaf4e00 already deleted. [ 937.493951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e78cc116-f222-4a70-a253-aeffffaf4e00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.798620] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: SUCCESS [ 937.798854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.799031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.799254] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.799451] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.799567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.799633] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.799784] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.799865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.799950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.800052] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.304721] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.305040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.305040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.305248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.305433] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.305541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.305611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.305828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.305877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.305943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.306145] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.306240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.306304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.306448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.306602] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.306697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.306755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.306891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.306966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.307062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.307164] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.810359] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b: rpc.has_security_group_logging(os_id): False [ 938.828336] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.828559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.828659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.828892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.828978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.829213] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.829315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.829376] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.829547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.829628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.829870] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.829965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.830057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.830201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.830286] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.830476] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.830612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.830658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.830806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.830887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.830970] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b is going to be created. [ 938.919955] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.920170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.920170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.920401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.920654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.930641] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: IN_PROGRESS for 2s [ 940.943826] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: SUCCESS [ 940.944167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.991175] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 941.991487] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 946.928404] env[69656]: INFO networking_nsxv3.common.synchronization [req-8393a317-7df6-4cf7-8940-3098d2629e81 req-92ca08be-63b9-44ca-82a7-a315896a6395 tempest-AttachInterfacesUnderV243Test-816866037 tempest-AttachInterfacesUnderV243Test-816866037-project-member] Enqueued Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 946.928957] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 946.929291] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.929413] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.929480] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.929731] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.929888] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.929981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.930056] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.930222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.930314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.930402] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.415288] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-546 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.415288] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-546" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.415288] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-546" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.415288] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-546" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.415288] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.415288] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.415288] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.415288] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.415623] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.415623] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.415738] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.415846] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.415955] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.416158] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.416280] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.416450] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.433542] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.433703] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.433753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.433936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.434038] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.434269] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.434371] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.434434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.434587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.434704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.434791] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7521520c-f746-46f0-bf0e-85f9284fde61 already deleted. [ 947.434870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.442124] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.442308] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 947.442447] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.442622] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-546" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.442899] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.443110] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.443357] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.444503] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.444503] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0fb0727-6499-44d4-bd2d-adc12f4cb3d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.946581] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.946927] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.947133] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.948034] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.948034] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.948034] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 not found, creating... [ 947.948238] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.948462] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.948518] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.948854] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.949019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.949373] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.949570] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.949728] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.949987] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.950181] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.950341] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 is going to be created. [ 947.970825] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.971093] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.971237] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.971555] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.971841] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.972116] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.847669] env[69656]: INFO networking_nsxv3.common.synchronization [req-8393a317-7df6-4cf7-8940-3098d2629e81 req-86e4eaba-57a3-4d14-8765-47bde9fdcd76 service nova] Enqueued Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_rules [ 948.847866] env[69656]: INFO networking_nsxv3.common.synchronization [req-8393a317-7df6-4cf7-8940-3098d2629e81 req-86e4eaba-57a3-4d14-8765-47bde9fdcd76 service nova] Enqueued Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 948.848017] env[69656]: INFO networking_nsxv3.common.synchronization [req-8393a317-7df6-4cf7-8940-3098d2629e81 req-86e4eaba-57a3-4d14-8765-47bde9fdcd76 service nova] Enqueued Resource ID: c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 with Priority: HIGHEST for action port [ 948.849800] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_rules [ 948.849800] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 948.849800] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 with Priority: HIGHEST for action port [ 948.849800] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.850924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.851130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.851179] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.851263] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.855073] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.855194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.855260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.855439] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.855750] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.855750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.855750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.856210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.856210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.856210] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.856791] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.856915] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.856983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.857163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.857240] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0fb0727-6499-44d4-bd2d-adc12f4cb3d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.356358] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.356358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.363216] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.364186] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 with status ACTIVE [ 949.364394] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.365027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.365027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.365027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.365027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.365027] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.365243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.365243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.365340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.365404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.365582] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.365646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.365698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.365831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.365907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.365990] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 is going to be updated. [ 949.387272] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.387411] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.387483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.387677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.387811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.387999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.641688] env[69656]: INFO networking_nsxv3.common.synchronization [req-d978c3c5-6d5b-48fc-8ad2-f8885c59f7f2 req-181810e5-122d-4d63-9686-b61dd197c7a1 tempest-ServersWithSpecificFlavorTestJSON-7449257 tempest-ServersWithSpecificFlavorTestJSON-7449257-project-member] Enqueued Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_members [ 949.642226] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_members [ 949.642525] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.642650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.642718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.642910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.643989] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.644130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.645451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.645637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.645730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.645826] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.869092] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.150080] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.150080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.150080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.150080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.170018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.170018] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.170018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.170018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.170018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.170018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.170018] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 is going to be updated. [ 950.201026] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-103 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.201026] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-103" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.201026] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-103" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.201026] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-103" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.201026] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.201026] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.201026] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.201026] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.201899] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.202485] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.203569] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.204065] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.204346] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.204649] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.204957] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.205563] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.207832] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.208590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.208590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.208936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.211408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.220059] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: IN_PROGRESS for 2s [ 950.230594] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.230594] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 950.230594] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.230594] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-103" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.230594] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-0773f85b-a530-4cb4-b940-4227e52454e9 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.230594] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-0773f85b-a530-4cb4-b940-4227e52454e9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.230872] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-0773f85b-a530-4cb4-b940-4227e52454e9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.231066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-0773f85b-a530-4cb4-b940-4227e52454e9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.232034] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0773f85b-a530-4cb4-b940-4227e52454e9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.370569] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.370917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.370966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.372032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.372032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.372032] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7521520c-f746-46f0-bf0e-85f9284fde61 is going to be created. [ 950.395185] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.395185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.395185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.395335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.395368] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.405731] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7521520c-f746-46f0-bf0e-85f9284fde61 in Status: UNINITIALIZED for 2s [ 950.733871] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.734168] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.734234] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.734611] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.734773] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.735052] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 0773f85b-a530-4cb4-b940-4227e52454e9 not found, creating... [ 950.735306] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.735474] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.735634] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.736025] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.736204] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.736510] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.736762] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.736851] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.739175] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.739375] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.739540] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 0773f85b-a530-4cb4-b940-4227e52454e9 is going to be created. [ 950.761887] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.762095] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.762141] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.762388] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.762637] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.762897] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-0773f85b-a530-4cb4-b940-4227e52454e9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.173825] env[69656]: INFO networking_nsxv3.common.synchronization [req-aa3bcc1f-7aff-477b-bcd3-854ad23f1048 req-7b2038eb-73c4-46a9-9b84-3fee8c00b28f tempest-MigrationsAdminTest-978699219 tempest-MigrationsAdminTest-978699219-project-member] Enqueued Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_members [ 951.174513] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_members [ 951.174822] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.174983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.176244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.176244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.176244] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.176244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.176424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.176515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.176592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.176761] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.640169] env[69656]: INFO networking_nsxv3.common.synchronization [req-d978c3c5-6d5b-48fc-8ad2-f8885c59f7f2 req-67b01d89-58ed-4aaa-850c-7721a90101bd service nova] Enqueued Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_rules [ 951.640169] env[69656]: INFO networking_nsxv3.common.synchronization [req-d978c3c5-6d5b-48fc-8ad2-f8885c59f7f2 req-67b01d89-58ed-4aaa-850c-7721a90101bd service nova] Enqueued Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_members [ 951.640169] env[69656]: INFO networking_nsxv3.common.synchronization [req-d978c3c5-6d5b-48fc-8ad2-f8885c59f7f2 req-67b01d89-58ed-4aaa-850c-7721a90101bd service nova] Enqueued Resource ID: 0773f85b-a530-4cb4-b940-4227e52454e9 with Priority: HIGHEST for action port [ 951.640169] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_rules [ 951.640169] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_members [ 951.640169] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0773f85b-a530-4cb4-b940-4227e52454e9 with Priority: HIGHEST for action port [ 951.640966] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.640966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.642132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.642132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.642132] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.642400] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.642470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.642715] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-0773f85b-a530-4cb4-b940-4227e52454e9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.642865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0773f85b-a530-4cb4-b940-4227e52454e9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.642981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0773f85b-a530-4cb4-b940-4227e52454e9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.643224] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0773f85b-a530-4cb4-b940-4227e52454e9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.643341] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0773f85b-a530-4cb4-b940-4227e52454e9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.681662] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.145055] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.145292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.148155] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0773f85b-a530-4cb4-b940-4227e52454e9 with status ACTIVE [ 952.148368] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.148489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.148558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.148789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.148885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.149085] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.149184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.149246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.149417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.149497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.149675] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.149780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.149843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.150010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.150093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.150198] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0773f85b-a530-4cb4-b940-4227e52454e9 is going to be updated. [ 952.173657] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.175173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.177193] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.177420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.177887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.177887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0773f85b-a530-4cb4-b940-4227e52454e9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.183443] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.229973] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: SUCCESS [ 952.230189] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 deletion is rescheduled due to dependency. [ 952.230304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.230459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.230684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.230881] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.231077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.231155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.231343] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.231435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.231543] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.431357] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7521520c-f746-46f0-bf0e-85f9284fde61 in Status: SUCCESS [ 952.432106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.432314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.432533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.432782] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.432920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.432985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.433178] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.433255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.433336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.433423] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.686121] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.686492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.686492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.686559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.686990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.687135] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 792b043f-2560-4918-890f-99f50b059db4 is going to be updated. [ 952.733822] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.735956] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.736111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.736181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.736388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.736528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.746674] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: IN_PROGRESS for 2s [ 952.936452] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.236245] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.438803] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7521520c-f746-46f0-bf0e-85f9284fde61: rpc.has_security_group_logging(os_id): False [ 953.455880] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.456046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.456116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.456324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.456416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.456665] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.456769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.456831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.456983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.457074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.457159] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7521520c-f746-46f0-bf0e-85f9284fde61 is going to be created. [ 953.520224] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.520455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.520633] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.521099] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.521349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.534160] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7521520c-f746-46f0-bf0e-85f9284fde61 in Status: IN_PROGRESS for 2s [ 953.741070] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.741070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.741070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.741070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.741070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.741070] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 is going to be updated. [ 953.770827] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.770987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.771067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.771271] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.771412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.779301] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: IN_PROGRESS for 2s [ 954.558564] env[69656]: INFO networking_nsxv3.common.synchronization [req-e9671980-7dec-4ecf-a32c-21e415b0c3c6 req-3aa03b61-4576-45bd-a237-83bae4db1c6b tempest-ServerDiskConfigTestJSON-2110996415 tempest-ServerDiskConfigTestJSON-2110996415-project-member] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 954.559129] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 954.559479] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.559626] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.559726] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.559952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.560188] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.560312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.560416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.560595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.560725] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.560824] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.757092] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: SUCCESS [ 954.757390] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.062706] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.062835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.062910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.063176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.063275] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.063470] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.063569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.063632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.063783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.064054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.064054] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 955.077211] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-940 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.077211] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.077211] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.077211] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.077211] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.077211] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.077211] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.077211] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.077211] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.077513] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.077513] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.077612] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.077779] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.077866] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.077977] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.078127] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.089382] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.089571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.089571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.089743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.089877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.095353] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.095516] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 955.095660] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.095828] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.096122] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-3245fb8e-a90a-4ff5-bb68-cd23dc0cd585 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.096289] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-3245fb8e-a90a-4ff5-bb68-cd23dc0cd585" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.096411] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-3245fb8e-a90a-4ff5-bb68-cd23dc0cd585" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.096696] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-3245fb8e-a90a-4ff5-bb68-cd23dc0cd585" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.096867] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3245fb8e-a90a-4ff5-bb68-cd23dc0cd585',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.098426] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 955.546885] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7521520c-f746-46f0-bf0e-85f9284fde61 in Status: SUCCESS [ 955.547270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.600060] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.600332] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.600465] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.600805] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.600973] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.601146] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 3245fb8e-a90a-4ff5-bb68-cd23dc0cd585 not found, creating... [ 955.601409] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.601573] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.601701] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.602079] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.602237] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.602521] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.603066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.603066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.603066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.603245] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.603324] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 3245fb8e-a90a-4ff5-bb68-cd23dc0cd585 is going to be created. [ 955.625970] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.626194] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.626325] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.626587] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.626823] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.627063] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-3245fb8e-a90a-4ff5-bb68-cd23dc0cd585" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.790519] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: SUCCESS [ 955.790892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.790973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.791231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.791430] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.791549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.791617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.791813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.791912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.792008] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.792107] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.294038] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.534309] env[69656]: INFO networking_nsxv3.common.synchronization [req-e9671980-7dec-4ecf-a32c-21e415b0c3c6 req-e19515a3-8047-499a-aec1-9bf3dddcd336 service nova] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_rules [ 956.534511] env[69656]: INFO networking_nsxv3.common.synchronization [req-e9671980-7dec-4ecf-a32c-21e415b0c3c6 req-e19515a3-8047-499a-aec1-9bf3dddcd336 service nova] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 956.534630] env[69656]: INFO networking_nsxv3.common.synchronization [req-e9671980-7dec-4ecf-a32c-21e415b0c3c6 req-e19515a3-8047-499a-aec1-9bf3dddcd336 service nova] Enqueued Resource ID: 3245fb8e-a90a-4ff5-bb68-cd23dc0cd585 with Priority: HIGHEST for action port [ 956.534868] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_rules [ 956.534992] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 956.535097] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3245fb8e-a90a-4ff5-bb68-cd23dc0cd585 with Priority: HIGHEST for action port [ 956.536020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.536141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.536205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.536401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.536479] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.537287] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.537373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.537553] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-3245fb8e-a90a-4ff5-bb68-cd23dc0cd585 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.537643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3245fb8e-a90a-4ff5-bb68-cd23dc0cd585" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.537705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3245fb8e-a90a-4ff5-bb68-cd23dc0cd585" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.537865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3245fb8e-a90a-4ff5-bb68-cd23dc0cd585" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.537928] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3245fb8e-a90a-4ff5-bb68-cd23dc0cd585',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.796401] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b629ee2e-0b52-4f1a-9ab3-28190008dec5: rpc.has_security_group_logging(os_id): False [ 956.814303] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.814545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.814609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.814814] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.814913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.815190] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.815292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.815357] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.815511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.815590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.815676] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 is going to be updated. [ 956.881264] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.881461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.881461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.881684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.881859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.897960] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: IN_PROGRESS for 2s [ 957.040120] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.040120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.043422] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3245fb8e-a90a-4ff5-bb68-cd23dc0cd585 with status ACTIVE [ 957.043672] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.043814] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.043884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.044147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.044275] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.044433] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.044544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.044590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.044753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.044825] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.045034] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.045131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.045194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.045326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.045392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.045481] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3245fb8e-a90a-4ff5-bb68-cd23dc0cd585 is going to be updated. [ 957.067655] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.067843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.067922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.068226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.068365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.068698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3245fb8e-a90a-4ff5-bb68-cd23dc0cd585" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.115054] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 957.115054] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b deletion is rescheduled due to dependency. [ 957.115054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.115054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.115054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.115054] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.115054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.115054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.115054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.115054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.115054] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.617130] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.119459] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.130864] env[69656]: INFO networking_nsxv3.common.synchronization [req-47de09a3-eecf-4ab0-90cd-3966cea8edc3 req-d050ada6-7641-4312-887a-da8a6254e925 tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_members [ 958.131652] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_members [ 958.131972] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.134381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.134455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.134666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.134845] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.134968] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.135056] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.135217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.135291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.135391] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.623567] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.623748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.623820] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.624061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.624167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.624308] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 958.638485] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.638485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.638485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.638778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.638905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.639148] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.639283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.639362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.639609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.639609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.642899] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b is going to be updated. [ 958.654088] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.654232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.654304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.654499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.654645] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.663924] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 958.665143] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.665275] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.665347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.665545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.665705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.672184] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: IN_PROGRESS for 2s [ 958.919850] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: SUCCESS [ 958.920147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.672742] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 960.673035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.673953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.674252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.674417] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.674499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.674548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.674688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.674770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.674856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.674962] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.681133] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: SUCCESS [ 960.682792] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b deletion is rescheduled due to dependency. [ 960.682792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.150160] env[69656]: INFO networking_nsxv3.common.synchronization [req-ea554a2b-0848-445a-90e0-cc25127ca415 req-a12f4386-74c5-43e7-96c0-9676ce7fb869 tempest-DeleteServersTestJSON-708906239 tempest-DeleteServersTestJSON-708906239-project-member] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 961.150713] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 961.151061] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.151424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.151523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.151821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.152017] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.152137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.152203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.152359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.152460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.152574] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.177525] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.177746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.177858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.178406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.178605] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.179024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.179024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.179242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.179430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.179557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.179851] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.180095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.180166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.180373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.180546] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.180652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.180716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.180907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.180988] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.181239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.181477] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.654939] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.655113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.655819] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.655819] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.655819] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.655819] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.655819] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.656132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.656132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.656132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.656270] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 already deleted. [ 961.656270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.684511] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ceadc5a6-0e5a-4475-96ab-3f4a1cec315b: rpc.has_security_group_logging(os_id): False [ 961.701654] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.701933] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.701933] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.702182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.702278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.702470] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.702587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.702652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.702804] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.702893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.703093] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.703460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.703460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.703460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.703460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.703644] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.703791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.703791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.703921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.703999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.704096] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 961.763741] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.764365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.764365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.764465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.764595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.776052] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 962.011953] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f605b05b-e09d-4b12-b14a-41bf2b6f7a4e None None] Enqueued Resource ID: 8dcf99d0-8303-4489-8cda-9eb82c75d336 with Priority: HIGHEST for action port [ 962.011953] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dcf99d0-8303-4489-8cda-9eb82c75d336 with Priority: HIGHEST for action port [ 962.012421] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dcf99d0-8303-4489-8cda-9eb82c75d336 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.012542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dcf99d0-8303-4489-8cda-9eb82c75d336" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.012610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dcf99d0-8303-4489-8cda-9eb82c75d336" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.012868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dcf99d0-8303-4489-8cda-9eb82c75d336" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.012951] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dcf99d0-8303-4489-8cda-9eb82c75d336',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.205790] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.206080] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.206285] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.206671] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.207046] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.207246] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.207436] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.207760] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.208013] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.208311] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.208491] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.208672] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.209064] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.209064] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.209177] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.209480] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.227646] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.227832] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 962.227995] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.231275] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.231275] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-167f4167-2abb-41df-9a25-7295d6b4eb51 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.231275] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-167f4167-2abb-41df-9a25-7295d6b4eb51" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.231275] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-167f4167-2abb-41df-9a25-7295d6b4eb51" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.231275] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-167f4167-2abb-41df-9a25-7295d6b4eb51" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.231275] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('167f4167-2abb-41df-9a25-7295d6b4eb51',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.517496] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8dcf99d0-8303-4489-8cda-9eb82c75d336 [ 962.517729] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.517871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.517942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.518184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.518278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.518375] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8dcf99d0-8303-4489-8cda-9eb82c75d336 already deleted. [ 962.518454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dcf99d0-8303-4489-8cda-9eb82c75d336" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.734458] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.734769] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.734813] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.735096] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.735247] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.735402] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 167f4167-2abb-41df-9a25-7295d6b4eb51 not found, creating... [ 962.735658] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.735816] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.735942] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.736229] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.736398] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.736661] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.736824] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.736946] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.737276] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.737453] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.737659] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 167f4167-2abb-41df-9a25-7295d6b4eb51 is going to be created. [ 962.758884] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.759125] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.759283] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.759511] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.759759] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.761028] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-167f4167-2abb-41df-9a25-7295d6b4eb51" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.705323] env[69656]: INFO networking_nsxv3.common.synchronization [None req-27f3c983-a18b-4992-810e-fda3dd76dbea tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: 70fe0bd2-1cbe-4f7c-8069-c5aff74f4735 with Priority: HIGHEST for action security_group_rules [ 963.705854] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fe0bd2-1cbe-4f7c-8069-c5aff74f4735 with Priority: HIGHEST for action security_group_rules [ 963.706258] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70fe0bd2-1cbe-4f7c-8069-c5aff74f4735 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.706376] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70fe0bd2-1cbe-4f7c-8069-c5aff74f4735" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.706462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70fe0bd2-1cbe-4f7c-8069-c5aff74f4735" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.707380] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70fe0bd2-1cbe-4f7c-8069-c5aff74f4735" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.707380] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70fe0bd2-1cbe-4f7c-8069-c5aff74f4735',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.759576] env[69656]: INFO networking_nsxv3.common.synchronization [req-ea554a2b-0848-445a-90e0-cc25127ca415 req-43b124d6-5edb-425c-8e3f-fda479ec13b1 service nova] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_rules [ 963.759816] env[69656]: INFO networking_nsxv3.common.synchronization [req-ea554a2b-0848-445a-90e0-cc25127ca415 req-43b124d6-5edb-425c-8e3f-fda479ec13b1 service nova] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 963.759850] env[69656]: INFO networking_nsxv3.common.synchronization [req-ea554a2b-0848-445a-90e0-cc25127ca415 req-43b124d6-5edb-425c-8e3f-fda479ec13b1 service nova] Enqueued Resource ID: 167f4167-2abb-41df-9a25-7295d6b4eb51 with Priority: HIGHEST for action port [ 963.760109] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_rules [ 963.760231] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 963.760330] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 167f4167-2abb-41df-9a25-7295d6b4eb51 with Priority: HIGHEST for action port [ 963.760893] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.761036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.761162] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.761355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.761467] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.762256] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.762371] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.762422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.762587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.762727] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.762821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.762883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.763036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.763154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.763247] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.764225] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-167f4167-2abb-41df-9a25-7295d6b4eb51 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.764225] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-167f4167-2abb-41df-9a25-7295d6b4eb51" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.764225] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-167f4167-2abb-41df-9a25-7295d6b4eb51" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.764413] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-167f4167-2abb-41df-9a25-7295d6b4eb51" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.764413] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('167f4167-2abb-41df-9a25-7295d6b4eb51',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.789446] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 963.789662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.799021] env[69656]: INFO networking_nsxv3.common.synchronization [None req-63618327-eb15-44b0-afd9-fc59007e557e tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: 70fe0bd2-1cbe-4f7c-8069-c5aff74f4735 with Priority: HIGHEST for action security_group_rules [ 963.799980] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fe0bd2-1cbe-4f7c-8069-c5aff74f4735 with Priority: HIGHEST for action security_group_rules [ 963.799980] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70fe0bd2-1cbe-4f7c-8069-c5aff74f4735 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.800151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70fe0bd2-1cbe-4f7c-8069-c5aff74f4735" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.895972] env[69656]: INFO networking_nsxv3.common.synchronization [None req-7087a297-448f-48b9-a185-b9519084788c tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGHEST for action security_group_rules [ 963.896472] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGHEST for action security_group_rules [ 963.896796] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.896923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.896992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.897253] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.897337] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3746f1b2-61cd-415b-a74b-1d4da3f9731f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.086061] env[69656]: INFO networking_nsxv3.common.synchronization [None req-025467fc-8ad7-41d8-952f-00f1f838d63f tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGHEST for action security_group_rules [ 964.086775] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGHEST for action security_group_rules [ 964.086883] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.086980] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.227738] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.227942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.228114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.228397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.228551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.228690] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70fe0bd2-1cbe-4f7c-8069-c5aff74f4735 already deleted. [ 964.228860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70fe0bd2-1cbe-4f7c-8069-c5aff74f4735" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.229404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70fe0bd2-1cbe-4f7c-8069-c5aff74f4735" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.229525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70fe0bd2-1cbe-4f7c-8069-c5aff74f4735" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.229592] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70fe0bd2-1cbe-4f7c-8069-c5aff74f4735',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.266347] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.266347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.266526] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.267947] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 167f4167-2abb-41df-9a25-7295d6b4eb51 with status ACTIVE [ 964.267947] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.267947] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.267947] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.268235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.268235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.268429] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.268526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.268587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.268807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.268966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.270512] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.270695] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.271487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.271723] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.271812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.271963] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 167f4167-2abb-41df-9a25-7295d6b4eb51 is going to be updated. [ 964.298015] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.298174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.298245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.298437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.298566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.298721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-167f4167-2abb-41df-9a25-7295d6b4eb51" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.341333] env[69656]: INFO networking_nsxv3.common.synchronization [None req-a6077dbd-e05e-44be-b3a1-7d869c7cba55 None None] Enqueued Resource ID: c5ffae40-6de2-486f-ba3d-25e86da6bef8 with Priority: HIGHEST for action port [ 964.342027] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ffae40-6de2-486f-ba3d-25e86da6bef8 with Priority: HIGHEST for action port [ 964.343111] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5ffae40-6de2-486f-ba3d-25e86da6bef8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.343278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5ffae40-6de2-486f-ba3d-25e86da6bef8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.343369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5ffae40-6de2-486f-ba3d-25e86da6bef8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.343648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5ffae40-6de2-486f-ba3d-25e86da6bef8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.343758] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5ffae40-6de2-486f-ba3d-25e86da6bef8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.417510] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.417649] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.417711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.417923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.418026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.418163] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f already deleted. [ 964.418467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.418467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.418467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.418924] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3746f1b2-61cd-415b-a74b-1d4da3f9731f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.529555] env[69656]: INFO networking_nsxv3.common.synchronization [req-c75e5c71-1dc7-4430-ba42-ea08026e6230 req-28ff1887-7e0d-40c2-b2a4-584c6000f051 tempest-ServersAdminTestJSON-1828746712 tempest-ServersAdminTestJSON-1828746712-project-member] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 964.530100] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 964.530402] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.530786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.530786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.530786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.531210] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.532325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.532325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.532540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.532540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.532633] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.749679] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.749843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.749917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.750533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.750533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.750533] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70fe0bd2-1cbe-4f7c-8069-c5aff74f4735 already deleted. [ 964.750533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70fe0bd2-1cbe-4f7c-8069-c5aff74f4735" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.777477] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.845882] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5ffae40-6de2-486f-ba3d-25e86da6bef8 [ 964.846123] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.846257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.846326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.846529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.846618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.846713] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5ffae40-6de2-486f-ba3d-25e86da6bef8 already deleted. [ 964.846814] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5ffae40-6de2-486f-ba3d-25e86da6bef8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.941734] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.942140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.942288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.942537] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.942657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.942780] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f already deleted. [ 964.942891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.034410] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.280078] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.280236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.280313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.280529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.280620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.280718] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be created. [ 965.315603] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.315764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.315814] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.316276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.316276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.326054] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: UNINITIALIZED for 2s [ 965.537204] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.041581] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.041938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.041938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.042590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.042590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.042590] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be updated. [ 966.070435] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.071174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.071414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.071748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.072057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.080731] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 966.273008] env[69656]: INFO networking_nsxv3.common.synchronization [req-2dc0bc54-112f-445c-9988-9e92892dc6b6 req-718f199f-4d6d-4fbe-b838-b06aa5654bfd tempest-ServerMetadataTestJSON-1999526637 tempest-ServerMetadataTestJSON-1999526637-project-member] Enqueued Resource ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 with Priority: HIGHEST for action security_group_members [ 966.273585] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 with Priority: HIGHEST for action security_group_members [ 966.273890] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd4ac7d-9012-443c-9954-5ea006504e81 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.274924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.275202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.275515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.276540] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.276888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.277091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.277677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.277839] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.278123] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd4ac7d-9012-443c-9954-5ea006504e81',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.740331] env[69656]: INFO networking_nsxv3.common.synchronization [req-d7c34bd3-cf0f-4cc3-90d7-9404fcccf697 req-fc3286f8-26a8-4e9c-b2f8-b90f6739774a tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGHEST for action security_group_members [ 966.741515] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGHEST for action security_group_members [ 966.742503] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a33f9cc8-ecf3-4437-910b-83546eec0eb5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.742503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.742503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.742503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.742503] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.742503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.742818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.742818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.742818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.742917] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.780746] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.780746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.780746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.780746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.780746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.781037] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.781037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.781284] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.781487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.781604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.781658] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 already deleted. [ 966.781746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.022115] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-46 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.022115] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-46" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.022115] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-46" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.022115] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-46" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.022115] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.022115] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.022115] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.023145] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.024814] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.024814] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.024814] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.024814] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.024814] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.024814] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.025168] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.025460] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.045417] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.045417] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 967.045417] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.045417] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-46" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.045417] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-efc0ac72-2933-4391-8cc2-8ff01e3da5cc taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.045417] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-efc0ac72-2933-4391-8cc2-8ff01e3da5cc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.045417] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-efc0ac72-2933-4391-8cc2-8ff01e3da5cc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.045417] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-efc0ac72-2933-4391-8cc2-8ff01e3da5cc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.045417] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efc0ac72-2933-4391-8cc2-8ff01e3da5cc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.245469] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.245642] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.245716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.246275] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.264807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.265085] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.265230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.265305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.265477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.265568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.265635] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 is going to be updated. [ 967.290719] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.290916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.290990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.291217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.291359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.299403] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 in Status: IN_PROGRESS for 2s [ 967.341838] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 967.342281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.342581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.343301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.343406] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.343574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.343713] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.344030] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.344218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.344432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.344622] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.550085] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.550322] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.550449] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.550754] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.552039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.552039] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port efc0ac72-2933-4391-8cc2-8ff01e3da5cc not found, creating... [ 967.552039] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.552222] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.552261] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.552511] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.552667] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.553163] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.553329] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.553457] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.557021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.557021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.557021] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: efc0ac72-2933-4391-8cc2-8ff01e3da5cc is going to be created. [ 967.572730] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.572891] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.573196] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.573460] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.573675] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.573913] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-efc0ac72-2933-4391-8cc2-8ff01e3da5cc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.848753] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.849065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.849205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.849597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.849850] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.849982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.850116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.850360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.850516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.850661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.850907] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.851134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.851191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.851364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.851586] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.851727] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.851863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.853734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.853928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.854111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.854111] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.093376] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 968.093691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.356689] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3274dea2-eaf7-4169-ba91-1154eac58032: rpc.has_security_group_logging(os_id): False [ 968.374608] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.374902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.375039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.375306] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.375450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.375716] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.375888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.375991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.376236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.376551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.377613] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.377734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.377791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.377952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.378038] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.378824] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.378824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.378824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.378824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.378824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.378824] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be created. [ 968.432803] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.432946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.433023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.433244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.433423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.442619] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 968.475027] env[69656]: INFO networking_nsxv3.common.synchronization [req-2dc0bc54-112f-445c-9988-9e92892dc6b6 req-f00ebd40-678a-4dbd-a562-0cd94f4ad6e8 service nova] Enqueued Resource ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 with Priority: HIGHEST for action security_group_rules [ 968.475228] env[69656]: INFO networking_nsxv3.common.synchronization [req-2dc0bc54-112f-445c-9988-9e92892dc6b6 req-f00ebd40-678a-4dbd-a562-0cd94f4ad6e8 service nova] Enqueued Resource ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 with Priority: HIGHEST for action security_group_members [ 968.475462] env[69656]: INFO networking_nsxv3.common.synchronization [req-2dc0bc54-112f-445c-9988-9e92892dc6b6 req-f00ebd40-678a-4dbd-a562-0cd94f4ad6e8 service nova] Enqueued Resource ID: efc0ac72-2933-4391-8cc2-8ff01e3da5cc with Priority: HIGHEST for action port [ 968.475706] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 with Priority: HIGHEST for action security_group_rules [ 968.475837] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 with Priority: HIGHEST for action security_group_members [ 968.475936] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc0ac72-2933-4391-8cc2-8ff01e3da5cc with Priority: HIGHEST for action port [ 968.476495] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dd4ac7d-9012-443c-9954-5ea006504e81 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.476619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.476686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.476934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.477640] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dd4ac7d-9012-443c-9954-5ea006504e81',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.480251] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd4ac7d-9012-443c-9954-5ea006504e81 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.480251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.480251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.480251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.480251] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.480251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.480251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.480251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.480251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.480251] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd4ac7d-9012-443c-9954-5ea006504e81',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.481052] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-efc0ac72-2933-4391-8cc2-8ff01e3da5cc taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.481151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efc0ac72-2933-4391-8cc2-8ff01e3da5cc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.481203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efc0ac72-2933-4391-8cc2-8ff01e3da5cc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.482128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efc0ac72-2933-4391-8cc2-8ff01e3da5cc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.482128] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efc0ac72-2933-4391-8cc2-8ff01e3da5cc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.912125] env[69656]: INFO networking_nsxv3.common.synchronization [req-addc595d-b8b1-4596-acfd-70091e3829b3 req-b144d307-b17a-4f37-b4eb-0629c631edea tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 968.912125] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 968.913457] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.913457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.913457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.913457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.913457] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.913457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.913457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.913457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.913829] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.913829] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.980051] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd4ac7d-9012-443c-9954-5ea006504e81 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.980217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.981504] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dd4ac7d-9012-443c-9954-5ea006504e81',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.987341] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efc0ac72-2933-4391-8cc2-8ff01e3da5cc with status ACTIVE [ 968.987341] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.987341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.987341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.987341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.987341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.987341] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.987341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.987341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.987341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.987341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.987341] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.987341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.987341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.987341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.987341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.987341] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efc0ac72-2933-4391-8cc2-8ff01e3da5cc is going to be updated. [ 969.018817] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.019028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.019111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.019312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.019451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.019613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efc0ac72-2933-4391-8cc2-8ff01e3da5cc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.310250] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 in Status: SUCCESS [ 969.310572] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 deletion is rescheduled due to dependency. [ 969.310760] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.384356] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.384568] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.384703] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.385097] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.385434] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.385669] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.385848] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.386160] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.386355] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.386602] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.386728] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.386843] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.386956] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.387083] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.387197] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.387336] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.406528] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.406528] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 969.406688] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.406862] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.407222] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-b70156ee-7aab-41a4-815a-5544f146297b taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.407413] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-b70156ee-7aab-41a4-815a-5544f146297b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.407562] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-b70156ee-7aab-41a4-815a-5544f146297b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.407932] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-b70156ee-7aab-41a4-815a-5544f146297b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.408095] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b70156ee-7aab-41a4-815a-5544f146297b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.416943] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.419015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.419015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.419015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.419015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.419015] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.419015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.419015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.419015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.419015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.419015] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 already deleted. [ 969.419015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.483829] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dd4ac7d-9012-443c-9954-5ea006504e81',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.911583] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.911583] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.911583] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.911809] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.911840] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.911983] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port b70156ee-7aab-41a4-815a-5544f146297b not found, creating... [ 969.912265] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.912424] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.912556] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.912780] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.912922] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.913255] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.913426] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.913546] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.913753] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.913892] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.914093] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: b70156ee-7aab-41a4-815a-5544f146297b is going to be created. [ 969.932145] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.932359] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.932487] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.932754] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.932983] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.933282] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-b70156ee-7aab-41a4-815a-5544f146297b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.986465] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.986643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.986710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.986914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.986999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.987109] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 is going to be created. [ 970.022838] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.022986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.023066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.023272] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.023424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.033328] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 in Status: UNINITIALIZED for 2s [ 970.454079] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 970.454327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.823985] env[69656]: INFO networking_nsxv3.common.synchronization [req-addc595d-b8b1-4596-acfd-70091e3829b3 req-00c0c28b-c89a-4c4d-a54d-362d811586de service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 970.824207] env[69656]: INFO networking_nsxv3.common.synchronization [req-addc595d-b8b1-4596-acfd-70091e3829b3 req-00c0c28b-c89a-4c4d-a54d-362d811586de service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 970.824349] env[69656]: INFO networking_nsxv3.common.synchronization [req-addc595d-b8b1-4596-acfd-70091e3829b3 req-00c0c28b-c89a-4c4d-a54d-362d811586de service nova] Enqueued Resource ID: b70156ee-7aab-41a4-815a-5544f146297b with Priority: HIGHEST for action port [ 970.824579] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 970.824709] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 970.824806] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70156ee-7aab-41a4-815a-5544f146297b with Priority: HIGHEST for action port [ 970.825376] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.825524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.825561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.825837] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.825879] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.826713] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.826805] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.826876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.827048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.827194] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.827288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.827350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.828364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.828364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.828364] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.828754] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-b70156ee-7aab-41a4-815a-5544f146297b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.828822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b70156ee-7aab-41a4-815a-5544f146297b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.828881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b70156ee-7aab-41a4-815a-5544f146297b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.829039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b70156ee-7aab-41a4-815a-5544f146297b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.829114] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b70156ee-7aab-41a4-815a-5544f146297b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.330550] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.330720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.331058] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.332018] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b70156ee-7aab-41a4-815a-5544f146297b with status ACTIVE [ 971.332246] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.332356] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.332416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.332640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.332767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.333058] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.333152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.333187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.333355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.333435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.333650] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.333731] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.333876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.333934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.333979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.335519] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b70156ee-7aab-41a4-815a-5544f146297b is going to be updated. [ 971.353655] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.353861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.353978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.354296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.354482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.354710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b70156ee-7aab-41a4-815a-5544f146297b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.836095] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.042951] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 in Status: SUCCESS [ 972.043337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.043506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.043788] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.043994] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.044132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.044201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.044365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.044446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.044532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.044664] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dd4ac7d-9012-443c-9954-5ea006504e81',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.338398] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.338684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.338684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.338852] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.338948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.339060] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be created. [ 972.370662] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.371034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.371034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.371260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.371341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.386599] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: UNINITIALIZED for 2s [ 972.546322] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd4ac7d-9012-443c-9954-5ea006504e81 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.546502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.546551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.546777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.546945] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.547063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.547128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.547276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.547362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.547449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.547626] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd4ac7d-9012-443c-9954-5ea006504e81 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.547671] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.547736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.547861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.547995] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.548097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.548157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.548291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.548367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.548447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.548534] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dd4ac7d-9012-443c-9954-5ea006504e81',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.056053] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dd4ac7d-9012-443c-9954-5ea006504e81: rpc.has_security_group_logging(os_id): False [ 973.071925] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.072614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.072614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.072614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.073341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.073341] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.073341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.073341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.073341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.073341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.073546] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.073590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.073711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.073787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.073856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.074507] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.074507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.074507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.074507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.074507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.074507] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 is going to be created. [ 973.152019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.152207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.152252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.152450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.152629] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.177276] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 in Status: IN_PROGRESS for 2s [ 974.397440] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 974.397726] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.397823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.398063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.398265] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.398426] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.398477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.398608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.398687] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.398829] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.398829] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.902404] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.902601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.902648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.902840] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.903018] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.903153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.903333] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.903412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.903480] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.903571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.903716] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.903807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.903868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.905104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.905397] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.905397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.905511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.905568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.905632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.905714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.905814] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.117153] env[69656]: INFO networking_nsxv3.common.synchronization [req-ed3c2f46-9113-40a9-a4c1-4013ab8705a2 req-5c1d3713-84e8-4969-9e60-131575bf5a55 tempest-DeleteServersTestJSON-708906239 tempest-DeleteServersTestJSON-708906239-project-member] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 975.117756] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 975.118111] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.118238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.118319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.118519] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.118686] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.118797] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.118863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.126322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.126322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.126322] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.188568] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 in Status: SUCCESS [ 975.188893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.409436] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06966f07-554f-446e-a2a7-17a62c52a519: rpc.has_security_group_logging(os_id): False [ 975.428854] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.428854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.428854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.428854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.428854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.429111] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.429188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.429250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.429404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.429483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.429677] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.429767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.429829] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.429965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.430059] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.430262] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.430395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.430461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.430604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.430679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.430764] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be created. [ 975.484230] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.484422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.484984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.485440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.485667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.497057] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 975.630171] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.630171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.630171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.635360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.635360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.635360] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.635360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.635360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.635360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.635360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.635360] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 975.661807] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.662030] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.662094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.662460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.662624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.673528] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 975.788885] env[69656]: INFO networking_nsxv3.common.synchronization [req-f4351d0c-4b6b-4b5a-9661-29432c466b16 req-01a36745-21e7-41a5-ab18-dfb25f1e065d tempest-ListServerFiltersTestJSON-1060652857 tempest-ListServerFiltersTestJSON-1060652857-project-member] Enqueued Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 975.789337] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGHEST for action security_group_members [ 975.789593] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.789732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.789780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.790777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.790777] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.790777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.790963] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.791050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.791153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.791230] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.295234] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.295474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.295554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.295775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.316391] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.316640] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.316771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.317396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.317396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.317396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.317396] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d is going to be updated. [ 976.341810] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.341967] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.342075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.342240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.342379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.351216] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: IN_PROGRESS for 2s [ 977.508979] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 977.509417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.690277] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 977.690277] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 deletion is rescheduled due to dependency. [ 977.690277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.156557] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f8d1d90a-cd78-40b8-a55f-dfab7830ee2e None None] Enqueued Resource ID: 091aba2b-e751-492e-91d1-b4b5c7b30347 with Priority: HIGHEST for action port [ 978.156829] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091aba2b-e751-492e-91d1-b4b5c7b30347 with Priority: HIGHEST for action port [ 978.157451] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-091aba2b-e751-492e-91d1-b4b5c7b30347 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.157572] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-091aba2b-e751-492e-91d1-b4b5c7b30347" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.157632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-091aba2b-e751-492e-91d1-b4b5c7b30347" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.157902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-091aba2b-e751-492e-91d1-b4b5c7b30347" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.157982] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('091aba2b-e751-492e-91d1-b4b5c7b30347',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.362666] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d in Status: SUCCESS [ 978.362863] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d deletion is rescheduled due to dependency. [ 978.362986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.660378] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 091aba2b-e751-492e-91d1-b4b5c7b30347 [ 978.660708] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.660921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.661033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.661883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.661883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.661883] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:091aba2b-e751-492e-91d1-b4b5c7b30347 already deleted. [ 978.661883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-091aba2b-e751-492e-91d1-b4b5c7b30347" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.619026] env[69656]: INFO networking_nsxv3.common.synchronization [req-9702effd-eaaa-4bd2-ac6e-8fa93ccd72f9 req-7f6f83dc-2862-4c14-91c1-e6afed5ca3cb tempest-ServerDiskConfigTestJSON-2110996415 tempest-ServerDiskConfigTestJSON-2110996415-project-member] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 979.619026] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 979.619383] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.619690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.619983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.620280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.620551] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.620807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.620992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.621293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.621471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.621753] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.126665] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.126665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.126665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.126665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.126665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.126665] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.126665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.126665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.126665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.126665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.126665] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 980.163575] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.163825] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.163825] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.164014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.164182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.173678] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 980.362309] env[69656]: INFO networking_nsxv3.common.synchronization [None req-ac95f587-3c79-455a-8426-036a6251d84d None None] Enqueued Resource ID: 3eafa850-f4e7-404c-9b7a-44e14ca4d0d8 with Priority: HIGHEST for action port [ 980.364502] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eafa850-f4e7-404c-9b7a-44e14ca4d0d8 with Priority: HIGHEST for action port [ 980.365162] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-3eafa850-f4e7-404c-9b7a-44e14ca4d0d8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.365162] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3eafa850-f4e7-404c-9b7a-44e14ca4d0d8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.365273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3eafa850-f4e7-404c-9b7a-44e14ca4d0d8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.365969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3eafa850-f4e7-404c-9b7a-44e14ca4d0d8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.365969] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eafa850-f4e7-404c-9b7a-44e14ca4d0d8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.702742] env[69656]: INFO networking_nsxv3.common.synchronization [req-da593f54-66e5-4d32-adbe-4017b8528e53 req-be19e603-5e40-4edd-a1aa-4bd8344211fc tempest-ServersNegativeTestJSON-1253990888 tempest-ServersNegativeTestJSON-1253990888-project-member] Enqueued Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 980.703089] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 980.703420] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.703492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.703527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.703783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.703957] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.704920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.704997] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.705187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.705263] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.705360] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.870420] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3eafa850-f4e7-404c-9b7a-44e14ca4d0d8 [ 980.870679] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.870858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.870930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.871200] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.871328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.871378] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3eafa850-f4e7-404c-9b7a-44e14ca4d0d8 already deleted. [ 980.871456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3eafa850-f4e7-404c-9b7a-44e14ca4d0d8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.208034] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.208034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.208034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.209580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.209580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.209580] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.209580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.209580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.209580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.209580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.209580] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7976f89e-e748-4aab-bd17-3b945c409c8c already deleted. [ 981.209580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.349197] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-539 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.349197] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-539" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.349376] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-539" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.350011] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-539" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.350011] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.351367] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.352082] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.353069] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.353267] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.353523] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.353776] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.356483] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.356483] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.356483] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.356483] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.356483] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.376591] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.376778] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 981.376921] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.377321] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-539" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.377522] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.377714] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.377843] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.378179] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.378327] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a58748e-6aa1-4f39-9cbd-9737aba3b4d2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.880970] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.882452] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.882452] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.882452] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.882452] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.882452] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 not found, creating... [ 981.882452] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.882452] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.882750] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.882750] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.882852] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.883201] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.883371] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.883492] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.883703] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.883838] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.884050] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 is going to be created. [ 981.907640] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.908264] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.908264] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.908572] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.908857] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.909336] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.185429] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 982.185646] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b deletion is rescheduled due to dependency. [ 982.185766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.693976] env[69656]: INFO networking_nsxv3.common.synchronization [req-da593f54-66e5-4d32-adbe-4017b8528e53 req-a440cc79-b0c1-4c81-a66f-08777f9fbee0 service nova] Enqueued Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_rules [ 982.693976] env[69656]: INFO networking_nsxv3.common.synchronization [req-da593f54-66e5-4d32-adbe-4017b8528e53 req-a440cc79-b0c1-4c81-a66f-08777f9fbee0 service nova] Enqueued Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 982.693976] env[69656]: INFO networking_nsxv3.common.synchronization [req-da593f54-66e5-4d32-adbe-4017b8528e53 req-a440cc79-b0c1-4c81-a66f-08777f9fbee0 service nova] Enqueued Resource ID: 4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 with Priority: HIGHEST for action port [ 982.693976] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_rules [ 982.693976] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 982.693976] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 with Priority: HIGHEST for action port [ 982.694518] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.694593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.694679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.694882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.694955] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.696580] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.696696] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.696763] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.696927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.697083] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.697174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.697233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.697370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.697449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.697532] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.698593] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.698695] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.698769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.698945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.699239] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a58748e-6aa1-4f39-9cbd-9737aba3b4d2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.201132] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.202595] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.202703] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.202865] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 with status ACTIVE [ 983.203065] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.203188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.203293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.203499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.203592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.203771] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.203859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.203918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.204355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.204461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.205302] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.205302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.205302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.205302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.205302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.205302] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 is going to be updated. [ 983.227378] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.227378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.227378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.227589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.227806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.228091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.316701] env[69656]: INFO networking_nsxv3.common.synchronization [req-62a8b5be-f0e8-4182-b329-09b567bf5ce7 req-104c1e74-30bb-4822-a339-462ba7bb9e0c tempest-ImagesOneServerNegativeTestJSON-384940824 tempest-ImagesOneServerNegativeTestJSON-384940824-project-member] Enqueued Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 983.317232] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 983.317540] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.317659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.317731] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.318133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.318133] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.318317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.318317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.318405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.318490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.318588] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.671383] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.671612] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.672069] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.672069] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.672550] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.672550] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.672715] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.672902] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.675476] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.676136] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.676641] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.677189] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.677387] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.680738] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.680738] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.680738] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.697536] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.697769] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 983.697872] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.698077] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.698412] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-f4e69b19-fef5-429b-ac9b-5a736d9fbde5 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.698646] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-f4e69b19-fef5-429b-ac9b-5a736d9fbde5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.699751] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-f4e69b19-fef5-429b-ac9b-5a736d9fbde5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.700016] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-f4e69b19-fef5-429b-ac9b-5a736d9fbde5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.701066] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4e69b19-fef5-429b-ac9b-5a736d9fbde5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.706735] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.794146] env[69656]: INFO networking_nsxv3.common.synchronization [req-c28b6291-d268-48d5-8be5-71150a525b05 req-c822f137-8d9b-4d70-a981-19ca37cd7a69 tempest-ServerMetadataTestJSON-1999526637 tempest-ServerMetadataTestJSON-1999526637-project-member] Enqueued Resource ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 with Priority: HIGHEST for action security_group_members [ 983.794645] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 with Priority: HIGHEST for action security_group_members [ 983.794941] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd4ac7d-9012-443c-9954-5ea006504e81 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.795089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.795171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.795339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.795550] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.795692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.795762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.795906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.795993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.796218] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd4ac7d-9012-443c-9954-5ea006504e81',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.821286] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.823080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.823080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.823080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.823080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.823080] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.823080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.823080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.823080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.823080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.823080] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf is going to be updated. [ 983.847059] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.847197] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.847266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.847720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.847892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.855882] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: IN_PROGRESS for 2s [ 984.204306] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.204710] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.204959] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.205370] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.205740] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.206049] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port f4e69b19-fef5-429b-ac9b-5a736d9fbde5 not found, creating... [ 984.206522] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.206800] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.207039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.207392] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.207642] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.208064] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.209039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.209039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.209039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.209039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.209039] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: f4e69b19-fef5-429b-ac9b-5a736d9fbde5 is going to be created. [ 984.210297] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.210416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.210502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.210672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.211310] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.212035] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7976f89e-e748-4aab-bd17-3b945c409c8c is going to be created. [ 984.231333] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.231333] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.231585] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.231897] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.232353] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.232465] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-f4e69b19-fef5-429b-ac9b-5a736d9fbde5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.235527] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.235732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.235906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.236110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.236353] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.248280] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: UNINITIALIZED for 2s [ 984.298093] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.298272] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.298334] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.298583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.298678] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.298873] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.298972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.299054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.299206] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.299284] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.299371] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 is going to be updated. [ 984.349046] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.349046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.349229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.349261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.349401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.359230] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 in Status: IN_PROGRESS for 2s [ 985.063174] env[69656]: INFO networking_nsxv3.common.synchronization [req-62a8b5be-f0e8-4182-b329-09b567bf5ce7 req-b8a74d28-71f1-45d2-ad89-fb0b5b9a285c service nova] Enqueued Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_rules [ 985.063440] env[69656]: INFO networking_nsxv3.common.synchronization [req-62a8b5be-f0e8-4182-b329-09b567bf5ce7 req-b8a74d28-71f1-45d2-ad89-fb0b5b9a285c service nova] Enqueued Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 985.063544] env[69656]: INFO networking_nsxv3.common.synchronization [req-62a8b5be-f0e8-4182-b329-09b567bf5ce7 req-b8a74d28-71f1-45d2-ad89-fb0b5b9a285c service nova] Enqueued Resource ID: f4e69b19-fef5-429b-ac9b-5a736d9fbde5 with Priority: HIGHEST for action port [ 985.064399] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_rules [ 985.064559] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 985.064657] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e69b19-fef5-429b-ac9b-5a736d9fbde5 with Priority: HIGHEST for action port [ 985.064934] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.065063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.065155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.065372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.067794] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.068264] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.068264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.068605] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4e69b19-fef5-429b-ac9b-5a736d9fbde5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.068605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4e69b19-fef5-429b-ac9b-5a736d9fbde5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.068723] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4e69b19-fef5-429b-ac9b-5a736d9fbde5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.068884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4e69b19-fef5-429b-ac9b-5a736d9fbde5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.069062] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4e69b19-fef5-429b-ac9b-5a736d9fbde5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.570854] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.571127] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.571237] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4e69b19-fef5-429b-ac9b-5a736d9fbde5 with status ACTIVE [ 985.571409] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.571521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.571587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.571803] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.571890] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.572152] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.572152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.572302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.572360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.572436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.572614] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.572705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.572762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.572893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.572964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.573059] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4e69b19-fef5-429b-ac9b-5a736d9fbde5 is going to be updated. [ 985.594154] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.594313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.594358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.594558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.594693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.594850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4e69b19-fef5-429b-ac9b-5a736d9fbde5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.821717] env[69656]: INFO networking_nsxv3.common.synchronization [req-b7f597c7-bd8b-4bd9-bfe8-1534dcb30afa req-4b07e51a-c46b-4261-8532-4a4a4ce94e58 tempest-ImagesTestJSON-514277302 tempest-ImagesTestJSON-514277302-project-member] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 985.821717] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 985.821717] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.822063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.822237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.822522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.822772] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.822987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.823140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.823430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.823623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.823809] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.868451] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: SUCCESS [ 985.868451] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf deletion is rescheduled due to dependency. [ 985.868451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.868451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.868451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.868451] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.868451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.868451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.868451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.868451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.868451] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.259455] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: SUCCESS [ 986.259455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.259455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.259455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.259455] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.259455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.259455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.259455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.259455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.259455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.259455] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.327907] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.367436] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 in Status: SUCCESS [ 986.367975] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 deletion is rescheduled due to dependency. [ 986.368290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.371762] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.400310] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.401957] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.401957] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.401957] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.401957] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.403036] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.403313] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.406744] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.406744] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.406744] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.406744] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.406744] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.406744] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.406744] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.406744] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.406744] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.422167] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.422418] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.422594] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.422963] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.423230] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-e87e9557-9bc8-4a95-82f7-3727e0e59f57 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.423447] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-e87e9557-9bc8-4a95-82f7-3727e0e59f57" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.423584] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-e87e9557-9bc8-4a95-82f7-3727e0e59f57" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.423949] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-e87e9557-9bc8-4a95-82f7-3727e0e59f57" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.424110] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e87e9557-9bc8-4a95-82f7-3727e0e59f57',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.762289] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.762489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.762489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.762704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.762795] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.762894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.762955] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.763152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.763246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.763348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.763499] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.763587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.763645] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.763788] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.763920] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.764026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.764086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.764209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.764279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.764360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.764447] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.829873] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.875539] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.929560] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.929736] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.929913] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.930203] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.930347] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.930510] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port e87e9557-9bc8-4a95-82f7-3727e0e59f57 not found, creating... [ 986.930775] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.930935] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.931107] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.931332] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.931474] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.931756] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.931917] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.932056] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.932271] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.932408] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.932550] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: e87e9557-9bc8-4a95-82f7-3727e0e59f57 is going to be created. [ 986.958913] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.959172] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.959309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.959572] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.959804] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.960045] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-e87e9557-9bc8-4a95-82f7-3727e0e59f57" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.266511] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7976f89e-e748-4aab-bd17-3b945c409c8c: rpc.has_security_group_logging(os_id): False [ 987.283676] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.283854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.283934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.284210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.284314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.284551] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.284665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.284775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.284989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.285096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.285301] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.285409] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.285456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.285643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.285643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.285892] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.286067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.286067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.286169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.286250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.286296] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7976f89e-e748-4aab-bd17-3b945c409c8c is going to be created. [ 987.332388] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.332539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.332599] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.332817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.332909] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.333014] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 987.340152] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.340152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.340152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.340152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.340152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.350024] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: IN_PROGRESS for 2s [ 987.373038] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.373345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.373345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.373556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.373717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.378071] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.378071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.378071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.378071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.378071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.378071] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf is going to be updated. [ 987.381668] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 987.437036] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.437852] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.437939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.438180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.438324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.447751] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: IN_PROGRESS for 2s [ 988.208769] env[69656]: INFO networking_nsxv3.common.synchronization [req-b7f597c7-bd8b-4bd9-bfe8-1534dcb30afa req-39d6104d-6765-4596-8b09-e8d2d4fc2808 service nova] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_rules [ 988.208769] env[69656]: INFO networking_nsxv3.common.synchronization [req-b7f597c7-bd8b-4bd9-bfe8-1534dcb30afa req-39d6104d-6765-4596-8b09-e8d2d4fc2808 service nova] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 988.208769] env[69656]: INFO networking_nsxv3.common.synchronization [req-b7f597c7-bd8b-4bd9-bfe8-1534dcb30afa req-39d6104d-6765-4596-8b09-e8d2d4fc2808 service nova] Enqueued Resource ID: e87e9557-9bc8-4a95-82f7-3727e0e59f57 with Priority: HIGHEST for action port [ 988.208769] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_rules [ 988.208769] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 988.208769] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e87e9557-9bc8-4a95-82f7-3727e0e59f57 with Priority: HIGHEST for action port [ 988.208769] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.208769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.209728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.212179] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.212179] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.218134] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.218134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.218134] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e87e9557-9bc8-4a95-82f7-3727e0e59f57 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.218134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e87e9557-9bc8-4a95-82f7-3727e0e59f57" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.218134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e87e9557-9bc8-4a95-82f7-3727e0e59f57" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.218134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e87e9557-9bc8-4a95-82f7-3727e0e59f57" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.218134] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e87e9557-9bc8-4a95-82f7-3727e0e59f57',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.717154] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.717491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.720746] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e87e9557-9bc8-4a95-82f7-3727e0e59f57 with status ACTIVE [ 988.720911] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.721065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.721138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.721368] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.721460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.721603] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.721700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.721811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.721898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.722017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.722244] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.722313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.722385] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.722461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.722535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.722613] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e87e9557-9bc8-4a95-82f7-3727e0e59f57 is going to be updated. [ 988.742880] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.743067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.743145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.743340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.743481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.743633] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e87e9557-9bc8-4a95-82f7-3727e0e59f57" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.360198] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: SUCCESS [ 989.360849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.390625] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 989.390918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.391182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.394350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.394350] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.394350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.394350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.394350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.394350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.394350] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.459492] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: SUCCESS [ 989.459492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.459492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.459492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.459492] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.459492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.459492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.459492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.459492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.459492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.459492] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.869924] env[69656]: INFO networking_nsxv3.common.synchronization [req-7b59a880-ff11-4206-b485-5bbc74f295d2 req-0adc9b2e-73ba-4629-830f-b57a6d5111f2 tempest-MigrationsAdminTest-978699219 tempest-MigrationsAdminTest-978699219-project-member] Enqueued Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_members [ 989.870388] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGHEST for action security_group_members [ 989.870974] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.870974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.870974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.871228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.871396] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.871500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.871563] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.871729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.871811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.871906] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.894946] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.962047] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.962047] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.962047] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.962047] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.962331] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.962331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.962331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.962454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.962535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.962625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.962768] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.962861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.962921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.963079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.963234] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.963332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.963391] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.963548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.963624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.963724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.963813] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.374369] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.374512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.374551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.374785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.394819] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.395928] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.396317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.397024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.397024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.397024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.397024] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 792b043f-2560-4918-890f-99f50b059db4 is going to be updated. [ 990.398111] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.422510] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.422664] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.422824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.422952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.423152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.431855] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: IN_PROGRESS for 2s [ 990.465893] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e938057-3189-4358-8ca5-5e18d05bbddf: rpc.has_security_group_logging(os_id): False [ 990.487107] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.487277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.487342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.488223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.488223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.488223] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.488223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.488223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.488223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.488661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.488661] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.488661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.488661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.488781] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.488781] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.488939] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.489032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.489117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.489230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.489382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.489382] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf is going to be updated. [ 990.554848] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.555034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.555080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.555301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.555447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.569995] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: IN_PROGRESS for 2s [ 990.878712] env[69656]: INFO networking_nsxv3.common.synchronization [None req-80557257-f6aa-416d-8f38-42e2d379f84e tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 with Priority: HIGHEST for action security_group_rules [ 990.879340] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 with Priority: HIGHEST for action security_group_rules [ 990.879669] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77d2c3a5-526e-400a-8792-5423d2e6c534 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.879810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.879870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.880150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.880240] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77d2c3a5-526e-400a-8792-5423d2e6c534',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.901352] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.901523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.901587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.901780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.901869] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.901967] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 990.932656] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.932832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.932880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.933172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.933326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.941597] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 990.958310] env[69656]: INFO networking_nsxv3.common.synchronization [None req-66b228d8-521e-4701-b5ad-954af4685fe3 tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 with Priority: HIGHEST for action security_group_rules [ 990.959142] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 with Priority: HIGHEST for action security_group_rules [ 990.959249] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77d2c3a5-526e-400a-8792-5423d2e6c534 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.959368] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.400341] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.400493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.400493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.400735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.402111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.402111] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 already deleted. [ 991.402111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.402111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.402111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.402111] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77d2c3a5-526e-400a-8792-5423d2e6c534',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.923958] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.924289] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.924289] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.925060] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.925238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.925747] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 already deleted. [ 991.925747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.442787] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 792b043f-2560-4918-890f-99f50b059db4 in Status: SUCCESS [ 992.443102] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 792b043f-2560-4918-890f-99f50b059db4 deletion is rescheduled due to dependency. [ 992.443102] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.585361] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: SUCCESS [ 992.586031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.956549] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 992.956917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.957103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.957375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.957609] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.957745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.957831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.958057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.958182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.958294] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.958390] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.010303] env[69656]: INFO networking_nsxv3.common.synchronization [req-5ec9a9ef-e5ba-4c31-9e93-e5a1498315de req-b2075a49-1857-4ced-bcc2-308da33ac932 tempest-ServersAdminTestJSON-1828746712 tempest-ServersAdminTestJSON-1828746712-project-member] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 993.010817] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 993.012232] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.012482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.012927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.012927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.013112] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.013258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.013361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.013586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.013849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.013849] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.466020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.466020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.466020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.466020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.466020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.466020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.466020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.466020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.466020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.466020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.466020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.466020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.466020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.466020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.466020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.466020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.466796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.466796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.466796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.466796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.466796] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.517154] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.969260] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a714e7c-1123-47f3-81e4-70f097603f3e: rpc.has_security_group_logging(os_id): False [ 993.986319] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.986508] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.986591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.986838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.986939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.987148] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.987264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.987360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.987476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.987554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.987744] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.987850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.987914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.988072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.988149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.988326] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.988419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.988479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.988615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.988688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.988772] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 994.022593] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.048182] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.048697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.048787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.048990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.049195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.059146] env[69656]: INFO networking_nsxv3.common.synchronization [req-5ded958d-07e2-43ab-9eeb-2df35080cf9d req-51dbbc53-1aac-4c30-9c35-48048253e353 tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGHEST for action security_group_members [ 994.059848] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGHEST for action security_group_members [ 994.059948] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3746f1b2-61cd-415b-a74b-1d4da3f9731f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.060077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.060127] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.060388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.060539] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.060634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.060720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.060836] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.060917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.061049] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3746f1b2-61cd-415b-a74b-1d4da3f9731f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.065832] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 994.525367] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.526260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.526346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.526586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.526683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.526790] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be updated. [ 994.555720] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.555866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.555947] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.556172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.556314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.563210] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.563386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.563474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.563657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.563745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.563928] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.564043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.564129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.564246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.564367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.564413] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f already deleted. [ 994.564468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.566764] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 994.683173] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-565 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.683429] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.683561] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.683873] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.684589] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.684772] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.684899] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.685144] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.685300] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.685521] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.685640] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.685758] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.685874] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.685990] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.686119] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.686260] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.703812] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.703990] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 994.704154] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.704345] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.704664] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-55dd4b42-a4ad-40e7-b702-c096cddea7bc taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.704907] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-55dd4b42-a4ad-40e7-b702-c096cddea7bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.704984] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-55dd4b42-a4ad-40e7-b702-c096cddea7bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.705373] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-55dd4b42-a4ad-40e7-b702-c096cddea7bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.705475] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55dd4b42-a4ad-40e7-b702-c096cddea7bc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.208778] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.209237] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.209327] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.209608] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.209958] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.210221] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 55dd4b42-a4ad-40e7-b702-c096cddea7bc not found, creating... [ 995.210536] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.210758] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.210915] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.211260] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.211415] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.211783] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.211999] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.212157] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.212488] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.212688] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.212871] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 55dd4b42-a4ad-40e7-b702-c096cddea7bc is going to be created. [ 995.241516] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.242405] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.242405] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.243459] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.243459] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.243459] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-55dd4b42-a4ad-40e7-b702-c096cddea7bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.476825] env[69656]: INFO networking_nsxv3.common.synchronization [None req-375570ad-7383-48d3-a371-19a10dc048da tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: 1d9405cd-478a-474f-af17-55246ce5acfa with Priority: HIGHEST for action security_group_rules [ 995.477790] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9405cd-478a-474f-af17-55246ce5acfa with Priority: HIGHEST for action security_group_rules [ 995.478124] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d9405cd-478a-474f-af17-55246ce5acfa taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.478282] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.478365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.478619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.478698] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d9405cd-478a-474f-af17-55246ce5acfa',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.596248] env[69656]: INFO networking_nsxv3.common.synchronization [None req-064888e0-aba8-41c2-8b9e-aef61121a86b tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: 1d9405cd-478a-474f-af17-55246ce5acfa with Priority: HIGHEST for action security_group_rules [ 995.596930] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9405cd-478a-474f-af17-55246ce5acfa with Priority: HIGHEST for action security_group_rules [ 995.597407] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d9405cd-478a-474f-af17-55246ce5acfa taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.597515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.999325] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.999486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.999573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.999770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.999880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.999950] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d9405cd-478a-474f-af17-55246ce5acfa already deleted. [ 996.000093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.000204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.000363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.000460] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d9405cd-478a-474f-af17-55246ce5acfa',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.082609] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 996.082850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.190234] env[69656]: INFO networking_nsxv3.common.synchronization [req-5ded958d-07e2-43ab-9eeb-2df35080cf9d req-b4c13ac4-0d67-461f-a94b-58c880f5ef78 service nova] Enqueued Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGHEST for action security_group_rules [ 996.190430] env[69656]: INFO networking_nsxv3.common.synchronization [req-5ded958d-07e2-43ab-9eeb-2df35080cf9d req-b4c13ac4-0d67-461f-a94b-58c880f5ef78 service nova] Enqueued Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGHEST for action security_group_members [ 996.190573] env[69656]: INFO networking_nsxv3.common.synchronization [req-5ded958d-07e2-43ab-9eeb-2df35080cf9d req-b4c13ac4-0d67-461f-a94b-58c880f5ef78 service nova] Enqueued Resource ID: 55dd4b42-a4ad-40e7-b702-c096cddea7bc with Priority: HIGHEST for action port [ 996.190814] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGHEST for action security_group_rules [ 996.190950] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGHEST for action security_group_members [ 996.191085] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dd4b42-a4ad-40e7-b702-c096cddea7bc with Priority: HIGHEST for action port [ 996.191629] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.191752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.191820] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.192350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.192522] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3746f1b2-61cd-415b-a74b-1d4da3f9731f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.193281] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3746f1b2-61cd-415b-a74b-1d4da3f9731f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.193390] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.193459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.193629] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.193769] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.193859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.193921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.194089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.194183] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.194286] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3746f1b2-61cd-415b-a74b-1d4da3f9731f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.194962] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-55dd4b42-a4ad-40e7-b702-c096cddea7bc taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.195082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55dd4b42-a4ad-40e7-b702-c096cddea7bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.195195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55dd4b42-a4ad-40e7-b702-c096cddea7bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.195293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55dd4b42-a4ad-40e7-b702-c096cddea7bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.195365] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55dd4b42-a4ad-40e7-b702-c096cddea7bc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.523111] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.523462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.523462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.523651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.523743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.523843] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d9405cd-478a-474f-af17-55246ce5acfa already deleted. [ 996.523925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.575161] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 996.575345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.698794] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3746f1b2-61cd-415b-a74b-1d4da3f9731f taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.699736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.699736] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3746f1b2-61cd-415b-a74b-1d4da3f9731f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.700921] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55dd4b42-a4ad-40e7-b702-c096cddea7bc with status ACTIVE [ 996.700921] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.700921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.700921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.700921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.701443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.701443] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.701443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.701443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.702684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.702684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.702684] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.702684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.702912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.703142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.703337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.707023] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55dd4b42-a4ad-40e7-b702-c096cddea7bc is going to be updated. [ 996.727031] env[69656]: INFO networking_nsxv3.common.synchronization [req-a4a69d42-fe3d-4fe9-b895-6fa8d37cd328 req-7fd831d9-2ca2-4332-bafb-a8bbe0173300 tempest-ImagesOneServerNegativeTestJSON-384940824 tempest-ImagesOneServerNegativeTestJSON-384940824-project-member] Enqueued Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 996.727031] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e938057-3189-4358-8ca5-5e18d05bbddf with Priority: HIGHEST for action security_group_members [ 996.727031] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.727362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.727362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.727419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.727566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.727715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55dd4b42-a4ad-40e7-b702-c096cddea7bc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.728121] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e938057-3189-4358-8ca5-5e18d05bbddf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.728249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.728249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.728397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.728545] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.728638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.728699] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.728883] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.728967] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.730262] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e938057-3189-4358-8ca5-5e18d05bbddf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.208108] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3746f1b2-61cd-415b-a74b-1d4da3f9731f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.239291] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.239291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.239291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.239291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.239291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.239291] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.239291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.239291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.239291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.239291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.239291] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf is going to be updated. [ 997.265236] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.265236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.265236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.265943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.265943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.273775] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: IN_PROGRESS for 2s [ 997.710043] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.710420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.710420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.710497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.710587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.710738] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f is going to be created. [ 997.739786] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.739786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.739786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.739786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.739786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.748886] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f in Status: UNINITIALIZED for 2s [ 999.284070] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e938057-3189-4358-8ca5-5e18d05bbddf in Status: SUCCESS [ 999.284366] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e938057-3189-4358-8ca5-5e18d05bbddf deletion is rescheduled due to dependency. [ 999.284366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e938057-3189-4358-8ca5-5e18d05bbddf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.761962] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f in Status: SUCCESS [ 999.762187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.762346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.762577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.762754] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.762868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.763070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.763136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.763187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.763818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.763818] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3746f1b2-61cd-415b-a74b-1d4da3f9731f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.265523] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3746f1b2-61cd-415b-a74b-1d4da3f9731f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.770366] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3746f1b2-61cd-415b-a74b-1d4da3f9731f: rpc.has_security_group_logging(os_id): False [ 1000.788697] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.788987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.788987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.789189] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.789259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.789462] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.789574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.789639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.789777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.789848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.789929] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f is going to be created. [ 1000.851838] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.852015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.852057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.852292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.852482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.865288] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f in Status: IN_PROGRESS for 2s [ 1001.727400] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1001.727567] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1001.789650] env[69656]: INFO networking_nsxv3.common.synchronization [req-f35c9d58-963a-4797-a776-f5f7fcba94a3 req-4445ba2c-9e3b-461f-8aed-253b0cd4e715 tempest-ServerDiskConfigTestJSON-2110996415 tempest-ServerDiskConfigTestJSON-2110996415-project-member] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1001.790328] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1001.790695] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.790832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.790935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.791178] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.791356] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.791495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.791588] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.791752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.791865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.791998] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.294021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.294270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.294336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.294586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.294710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.295528] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.295528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.295528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.295528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.295528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.295528] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 1002.318135] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.318280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.318353] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.318561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.318731] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.327958] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 1002.393527] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-940 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.393735] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.393864] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.394174] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.394440] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.394728] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.394728] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.394952] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.395089] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.395307] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.395424] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.395535] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.395646] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.395759] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.395866] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.396060] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.413115] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.413290] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1002.413430] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.413629] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.414010] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-eb297dd3-efca-4cfe-b943-68e1416a0884 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.414207] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-eb297dd3-efca-4cfe-b943-68e1416a0884" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.414348] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-eb297dd3-efca-4cfe-b943-68e1416a0884" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.414706] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-eb297dd3-efca-4cfe-b943-68e1416a0884" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.414849] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb297dd3-efca-4cfe-b943-68e1416a0884',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.876811] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f in Status: SUCCESS [ 1002.877127] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.917436] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.917664] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.917795] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.918105] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.918266] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.918425] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port eb297dd3-efca-4cfe-b943-68e1416a0884 not found, creating... [ 1002.918688] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.918850] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.918970] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.919255] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.919399] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.919686] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.919843] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.919962] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.920184] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.920323] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.920465] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: eb297dd3-efca-4cfe-b943-68e1416a0884 is going to be created. [ 1002.942147] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.942503] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.942568] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.942875] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.943140] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.943384] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-eb297dd3-efca-4cfe-b943-68e1416a0884" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.711017] env[69656]: INFO networking_nsxv3.common.synchronization [req-f35c9d58-963a-4797-a776-f5f7fcba94a3 req-8ca0f458-aee2-4724-881b-6f0edeb4f966 service nova] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_rules [ 1003.711349] env[69656]: INFO networking_nsxv3.common.synchronization [req-f35c9d58-963a-4797-a776-f5f7fcba94a3 req-8ca0f458-aee2-4724-881b-6f0edeb4f966 service nova] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1003.711638] env[69656]: INFO networking_nsxv3.common.synchronization [req-f35c9d58-963a-4797-a776-f5f7fcba94a3 req-8ca0f458-aee2-4724-881b-6f0edeb4f966 service nova] Enqueued Resource ID: eb297dd3-efca-4cfe-b943-68e1416a0884 with Priority: HIGHEST for action port [ 1003.711887] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_rules [ 1003.712071] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1003.712162] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb297dd3-efca-4cfe-b943-68e1416a0884 with Priority: HIGHEST for action port [ 1003.712738] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.712867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.712936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.717021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.717021] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.717021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.717021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.717021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb297dd3-efca-4cfe-b943-68e1416a0884 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.717021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb297dd3-efca-4cfe-b943-68e1416a0884" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.717021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb297dd3-efca-4cfe-b943-68e1416a0884" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.717021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb297dd3-efca-4cfe-b943-68e1416a0884" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.717021] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb297dd3-efca-4cfe-b943-68e1416a0884',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.217543] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.217818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.218030] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb297dd3-efca-4cfe-b943-68e1416a0884 with status ACTIVE [ 1004.218066] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.218436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.218436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.218552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.218552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.218734] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.218842] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.218888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.219055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.219167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.219359] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.219454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.219535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.219677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.219776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.219845] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb297dd3-efca-4cfe-b943-68e1416a0884 is going to be updated. [ 1004.238865] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.239027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.239079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.239340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.239514] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.239739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb297dd3-efca-4cfe-b943-68e1416a0884" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.339652] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 1004.339841] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b deletion is rescheduled due to dependency. [ 1004.339957] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.340247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.340341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.340525] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.340639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.340707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.340850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.340931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.341036] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.843344] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.345755] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.850554] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.852255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.854395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.854395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.854395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.854395] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 1005.881456] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.881456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.881456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.881456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.881456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.887930] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 1006.784629] env[69656]: INFO networking_nsxv3.common.synchronization [req-48c10466-5bcc-408a-bd4a-2e762f70d09a req-dbde0e2e-5607-49b4-9a57-92d72b56295b tempest-ImagesTestJSON-514277302 tempest-ImagesTestJSON-514277302-project-member] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 1006.787020] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 1006.787020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.787020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.787020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.787020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.787020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.787020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.787020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.787020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.787020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.787020] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.963476] env[69656]: INFO networking_nsxv3.common.synchronization [req-b9e52dc3-7826-47f4-9af7-559e6937509e req-0a34c065-5ba1-4ce2-a41b-b0a72d1a6efd tempest-ServerRescueNegativeTestJSON-70641521 tempest-ServerRescueNegativeTestJSON-70641521-project-member] Enqueued Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_members [ 1006.963664] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_members [ 1006.965032] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.965032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.965032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.965032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.965032] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.965032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.965032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.965032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.965032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.965032] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.289469] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.316017] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.316247] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-357" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.316456] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-357" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.316815] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-357" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.317124] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.317306] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.317439] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.317672] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.317865] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.318122] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.318245] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.318378] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.318493] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.318608] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.318737] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.318873] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.337058] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.337118] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1007.337269] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.337562] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-357" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.338314] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-02ef64b1-77d1-4fa6-b760-2261bd62e8ed taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.338516] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-02ef64b1-77d1-4fa6-b760-2261bd62e8ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.338645] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-02ef64b1-77d1-4fa6-b760-2261bd62e8ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.338966] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-02ef64b1-77d1-4fa6-b760-2261bd62e8ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.339158] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02ef64b1-77d1-4fa6-b760-2261bd62e8ed',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.472109] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.472338] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.472430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.472701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.472840] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.473088] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.473199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.473305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.473492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.473573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.473701] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a already deleted. [ 1007.473791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.790713] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.841406] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.841667] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.841804] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.842122] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.842314] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.842504] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 02ef64b1-77d1-4fa6-b760-2261bd62e8ed not found, creating... [ 1007.842766] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.842930] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.843062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.843339] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.843445] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.843735] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.843893] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.844083] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.844319] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.844517] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.844682] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 02ef64b1-77d1-4fa6-b760-2261bd62e8ed is going to be created. [ 1007.863456] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.863702] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.863831] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.864167] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.864425] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.864719] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-02ef64b1-77d1-4fa6-b760-2261bd62e8ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.904087] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 1007.905025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.905025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.905025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.905025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.905025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.905266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.905266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.905322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.905415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.905507] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.293050] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.293050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.293050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.293320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.293320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.293404] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 1008.336810] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.336969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.337029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.337251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.337403] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.348901] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 1008.407910] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.408088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.408164] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.408386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.408562] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.408671] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.408735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.408880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.408967] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.409196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.409401] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.409501] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.409562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.409705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.409842] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.409934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.409994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.410143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.410220] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.410326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.410446] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.804468] env[69656]: INFO networking_nsxv3.common.synchronization [req-b9e52dc3-7826-47f4-9af7-559e6937509e req-48cf8dbd-d674-4ce6-9cd0-2c2a15db4ebb service nova] Enqueued Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_rules [ 1008.804739] env[69656]: INFO networking_nsxv3.common.synchronization [req-b9e52dc3-7826-47f4-9af7-559e6937509e req-48cf8dbd-d674-4ce6-9cd0-2c2a15db4ebb service nova] Enqueued Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_members [ 1008.804790] env[69656]: INFO networking_nsxv3.common.synchronization [req-b9e52dc3-7826-47f4-9af7-559e6937509e req-48cf8dbd-d674-4ce6-9cd0-2c2a15db4ebb service nova] Enqueued Resource ID: 02ef64b1-77d1-4fa6-b760-2261bd62e8ed with Priority: HIGHEST for action port [ 1008.804990] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_rules [ 1008.805126] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_members [ 1008.805225] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02ef64b1-77d1-4fa6-b760-2261bd62e8ed with Priority: HIGHEST for action port [ 1008.805760] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.805867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.805934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.806187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.806257] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.807187] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.807187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.807287] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.808256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.808256] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.808256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.808256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.808256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.808256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.808256] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.808689] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-02ef64b1-77d1-4fa6-b760-2261bd62e8ed taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.811811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02ef64b1-77d1-4fa6-b760-2261bd62e8ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.811811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02ef64b1-77d1-4fa6-b760-2261bd62e8ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.811811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02ef64b1-77d1-4fa6-b760-2261bd62e8ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.811811] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02ef64b1-77d1-4fa6-b760-2261bd62e8ed',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.912275] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ceadc5a6-0e5a-4475-96ab-3f4a1cec315b: rpc.has_security_group_logging(os_id): False [ 1008.934910] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.934910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.934910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.934910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.934910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.935413] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.935413] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.935413] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.935413] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.935413] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.935413] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.937618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.937618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.937618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.937618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.937997] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.938137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.938266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.938398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.938554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.938635] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 1008.995446] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.995594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.995666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.996599] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.996599] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.007879] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 1009.009705] env[69656]: INFO networking_nsxv3.common.synchronization [req-3f7b07c3-aa17-4c20-b033-3278474d372e req-ae834f88-61c3-4e36-8195-c3b07cb4ed86 tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1009.010012] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1009.010625] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.010795] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.010911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.011200] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.011398] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.011551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.011657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.011861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.011992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.012146] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.314361] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.314558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.314831] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.316119] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02ef64b1-77d1-4fa6-b760-2261bd62e8ed with status ACTIVE [ 1009.316346] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.316490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.316567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.316809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.316952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.317422] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.317654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.317748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.317953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.318110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.321811] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.321811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.321811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.321996] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.322055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.322185] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02ef64b1-77d1-4fa6-b760-2261bd62e8ed is going to be updated. [ 1009.348071] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.348071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.348071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.348071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.348071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.348071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02ef64b1-77d1-4fa6-b760-2261bd62e8ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.515028] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.547920] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.548197] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.548352] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.548675] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.548924] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.549099] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.549250] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.549525] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.549678] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.549915] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.550047] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.550166] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.550300] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.550420] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.550533] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.550669] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.567064] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.567193] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1009.567339] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.567513] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.567832] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-ac92eeae-2892-4284-8bc6-b3e72c1fbe7e taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.568025] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-ac92eeae-2892-4284-8bc6-b3e72c1fbe7e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.568163] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-ac92eeae-2892-4284-8bc6-b3e72c1fbe7e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.568482] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-ac92eeae-2892-4284-8bc6-b3e72c1fbe7e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.568640] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac92eeae-2892-4284-8bc6-b3e72c1fbe7e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.824398] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.017672] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.070849] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.071085] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.071293] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.071579] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.071732] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.071888] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port ac92eeae-2892-4284-8bc6-b3e72c1fbe7e not found, creating... [ 1010.072244] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.072422] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.072545] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.072758] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.072900] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.073197] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.073357] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.073516] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.073707] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.073893] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.074059] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: ac92eeae-2892-4284-8bc6-b3e72c1fbe7e is going to be created. [ 1010.092413] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.092594] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.092792] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.093173] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.093598] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.093865] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-ac92eeae-2892-4284-8bc6-b3e72c1fbe7e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.327550] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.327726] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.327802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.328035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.328133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.328234] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a is going to be created. [ 1010.351259] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.351259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.351259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.351259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.351259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.360242] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: UNINITIALIZED for 2s [ 1010.360879] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 1010.361077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.520174] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.520337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.520409] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.520623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.520713] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.520811] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1010.546518] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.546518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.546518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.547325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.547325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.557119] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1011.019252] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 1011.019600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.033948] env[69656]: INFO networking_nsxv3.common.synchronization [req-3f7b07c3-aa17-4c20-b033-3278474d372e req-2431759c-a6ef-4a86-828f-506123167d2d service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 1011.034215] env[69656]: INFO networking_nsxv3.common.synchronization [req-3f7b07c3-aa17-4c20-b033-3278474d372e req-2431759c-a6ef-4a86-828f-506123167d2d service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1011.034380] env[69656]: INFO networking_nsxv3.common.synchronization [req-3f7b07c3-aa17-4c20-b033-3278474d372e req-2431759c-a6ef-4a86-828f-506123167d2d service nova] Enqueued Resource ID: ac92eeae-2892-4284-8bc6-b3e72c1fbe7e with Priority: HIGHEST for action port [ 1011.034639] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 1011.034798] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1011.034875] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac92eeae-2892-4284-8bc6-b3e72c1fbe7e with Priority: HIGHEST for action port [ 1011.035520] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.035644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.035711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.036137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.039095] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.040472] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.040472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.040669] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac92eeae-2892-4284-8bc6-b3e72c1fbe7e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.040771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac92eeae-2892-4284-8bc6-b3e72c1fbe7e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.040835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac92eeae-2892-4284-8bc6-b3e72c1fbe7e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.041015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac92eeae-2892-4284-8bc6-b3e72c1fbe7e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.041097] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac92eeae-2892-4284-8bc6-b3e72c1fbe7e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.457990] env[69656]: INFO networking_nsxv3.common.synchronization [req-fea23755-67f8-42f5-82f0-6e757f318fb0 req-a6c3bd35-b692-4b41-b625-2cac4f12c250 tempest-ServerRescueNegativeTestJSON-70641521 tempest-ServerRescueNegativeTestJSON-70641521-project-member] Enqueued Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_members [ 1011.458519] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_members [ 1011.458823] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.458928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.544604] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.544604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.544604] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac92eeae-2892-4284-8bc6-b3e72c1fbe7e with status ACTIVE [ 1011.544604] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.544604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.544604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.544604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.544604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.544604] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.544604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.544604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.544604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.545104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.545104] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.545104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.545104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.545104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.545267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.545267] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac92eeae-2892-4284-8bc6-b3e72c1fbe7e is going to be updated. [ 1011.565333] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.565502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.565548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.566284] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.566284] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.566284] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac92eeae-2892-4284-8bc6-b3e72c1fbe7e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.211172] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.211172] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-357" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.211172] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-357" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.211957] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-357" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.212374] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.212709] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.212963] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.213333] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.213635] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.213976] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.214244] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.216018] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.216018] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.216018] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.216018] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.216018] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.237092] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.237092] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1012.237092] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.237092] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-357" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.237092] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-15cfa654-2dd4-42ad-81f7-c165db1ddb76 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.237092] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-15cfa654-2dd4-42ad-81f7-c165db1ddb76" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.237092] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-15cfa654-2dd4-42ad-81f7-c165db1ddb76" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.237092] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-15cfa654-2dd4-42ad-81f7-c165db1ddb76" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.237092] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15cfa654-2dd4-42ad-81f7-c165db1ddb76',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.369975] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: SUCCESS [ 1012.370245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.370425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.370648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.370841] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.370963] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.371039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.371221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.371298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.371384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.371482] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.379614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.379816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.379998] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.380129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.380194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.380340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.380422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.380517] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.565623] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1012.565842] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.566026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.566249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.566440] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.566559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.566624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.566776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.566858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.566951] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.739507] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.739781] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.739948] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.740288] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.740477] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.741040] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 15cfa654-2dd4-42ad-81f7-c165db1ddb76 not found, creating... [ 1012.741040] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.741300] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.741381] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.741581] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.741725] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.742027] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.742227] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.742425] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.742653] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.742796] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.742942] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 15cfa654-2dd4-42ad-81f7-c165db1ddb76 is going to be created. [ 1012.763719] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.763855] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.763981] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.764220] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.764441] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.764658] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-15cfa654-2dd4-42ad-81f7-c165db1ddb76" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.880208] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.880373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.882830] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.069933] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.384977] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.573449] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.822468] env[69656]: INFO networking_nsxv3.common.synchronization [req-fea23755-67f8-42f5-82f0-6e757f318fb0 req-34d7cd7b-d8ac-4f31-878b-0b71ed5600b3 service nova] Enqueued Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_rules [ 1013.822681] env[69656]: INFO networking_nsxv3.common.synchronization [req-fea23755-67f8-42f5-82f0-6e757f318fb0 req-34d7cd7b-d8ac-4f31-878b-0b71ed5600b3 service nova] Enqueued Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_members [ 1013.822848] env[69656]: INFO networking_nsxv3.common.synchronization [req-fea23755-67f8-42f5-82f0-6e757f318fb0 req-34d7cd7b-d8ac-4f31-878b-0b71ed5600b3 service nova] Enqueued Resource ID: 15cfa654-2dd4-42ad-81f7-c165db1ddb76 with Priority: HIGHEST for action port [ 1013.825310] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_rules [ 1013.825476] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_members [ 1013.825579] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cfa654-2dd4-42ad-81f7-c165db1ddb76 with Priority: HIGHEST for action port [ 1013.826031] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.826149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.826402] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.826477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.826679] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-15cfa654-2dd4-42ad-81f7-c165db1ddb76 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.826838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15cfa654-2dd4-42ad-81f7-c165db1ddb76" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.826911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15cfa654-2dd4-42ad-81f7-c165db1ddb76" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.827171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15cfa654-2dd4-42ad-81f7-c165db1ddb76" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.827284] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15cfa654-2dd4-42ad-81f7-c165db1ddb76',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.887492] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.887761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.887835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.888154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.888283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.888465] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a is going to be updated. [ 1013.915691] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.915691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.915691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.915691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.915691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.922586] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: IN_PROGRESS for 2s [ 1014.077020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.077020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.077020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.077020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.077020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.077020] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1014.101629] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.101780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.101820] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.102420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.102420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.109921] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1014.329400] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15cfa654-2dd4-42ad-81f7-c165db1ddb76 with status ACTIVE [ 1014.330074] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.330074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.330074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.330074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.330390] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.330390] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.330518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.330518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.330622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.330677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.330860] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.330949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.331019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.331155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.331325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.331481] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15cfa654-2dd4-42ad-81f7-c165db1ddb76 is going to be updated. [ 1014.350203] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.350371] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.350418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.350572] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.350698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.350846] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15cfa654-2dd4-42ad-81f7-c165db1ddb76" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.895740] env[69656]: INFO networking_nsxv3.common.synchronization [req-291c6035-eb81-4507-a792-85617fb33df8 req-d93fdd09-a2d6-4ee9-b11a-8bd2dccf5d82 tempest-ServersWithSpecificFlavorTestJSON-7449257 tempest-ServersWithSpecificFlavorTestJSON-7449257-project-member] Enqueued Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_members [ 1015.896498] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGHEST for action security_group_members [ 1015.896879] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.897082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.897199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.897436] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.897648] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.897792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.897890] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.898086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.898220] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.898356] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.933390] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: SUCCESS [ 1015.934027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.934351] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.934580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.934824] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.934992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.935112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.935329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.935442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.935573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.935784] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.935909] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.936020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.936228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.936434] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.936562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.936690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.936872] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.937022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.937181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.937295] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.938163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.938352] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.938524] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.938638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.938716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.938881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.938973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.939097] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.121337] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 4s [ 1016.400406] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.400656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.400656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.400895] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.400988] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.401691] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.401691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.401691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.401691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.401691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.401691] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 is going to be updated. [ 1016.427381] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.427799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.427955] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.428275] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.429188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.437311] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: IN_PROGRESS for 2s [ 1016.440728] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7af54d8-7472-45f1-aeff-b4e7f22e3f8a: rpc.has_security_group_logging(os_id): False [ 1016.441850] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.457218] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.457456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.457456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.457623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.457708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.457916] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.458521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.458521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.458521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.458521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.458691] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.458691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.458691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.458879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.458929] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.459224] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.459370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.462076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.462076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.462076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.462076] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a is going to be created. [ 1016.521113] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.521450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.521528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.521720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.522122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.539872] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: IN_PROGRESS for 2s [ 1016.945571] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.448570] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.448743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.448816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.449429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.449429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.449429] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a is going to be updated. [ 1017.478229] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.478318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.478495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.478644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.478830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.487181] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: IN_PROGRESS for 2s [ 1018.129564] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1018.129907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.129981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.130323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.130500] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.130623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.130689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.130857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.130985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.131104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.132204] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.447210] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 in Status: SUCCESS [ 1018.447318] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 deletion is rescheduled due to dependency. [ 1018.447458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.554228] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: SUCCESS [ 1018.554460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.554634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.554853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.556532] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.634833] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.635010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.635096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.635306] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.635476] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.635634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.635634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.635773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.635862] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.635950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.636109] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.636203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.636265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.636402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.636538] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.636670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.636670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.636807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.636893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.636974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.637081] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.058493] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.058640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.141292] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06966f07-554f-446e-a2a7-17a62c52a519: rpc.has_security_group_logging(os_id): False [ 1019.158028] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.158028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.158028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.158028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.158028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.158028] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.158028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.158028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.158028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.158028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.158028] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.158028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.158028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.158586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.158586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.158586] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.158690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.158837] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.159830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.159830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.159830] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1019.249800] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.249800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.249800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.250042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.250042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.270327] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1019.498093] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: SUCCESS [ 1019.498342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.498520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.498735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.498934] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.499071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.499172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.499328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.499411] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.499496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.499590] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.004823] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.005396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.005396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.005396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.005603] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.005603] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.006317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.006317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.006317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.006317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.006317] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.006317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.006317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.009205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.009205] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.009205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.009205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.009205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.009205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.009205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.009205] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.512160] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7af54d8-7472-45f1-aeff-b4e7f22e3f8a: rpc.has_security_group_logging(os_id): False [ 1020.529653] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.529653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.529653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.529653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.529653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.529653] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.529653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.529653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.530024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.530024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.530195] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.530195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.530296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.530386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.530451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.530635] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.530743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.530798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.530954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.531321] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.531417] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a is going to be updated. [ 1020.539381] env[69656]: INFO networking_nsxv3.common.synchronization [None req-b9b9317d-acc7-443d-995d-54a2cb571980 None None] Enqueued Resource ID: 54268a97-0553-4ee3-b6f6-8b4ef5f60202 with Priority: HIGHEST for action port [ 1020.540317] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54268a97-0553-4ee3-b6f6-8b4ef5f60202 with Priority: HIGHEST for action port [ 1020.540669] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-54268a97-0553-4ee3-b6f6-8b4ef5f60202 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.540844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54268a97-0553-4ee3-b6f6-8b4ef5f60202" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.541018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54268a97-0553-4ee3-b6f6-8b4ef5f60202" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.541465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54268a97-0553-4ee3-b6f6-8b4ef5f60202" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.541524] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54268a97-0553-4ee3-b6f6-8b4ef5f60202',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.585547] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.585705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.585804] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.586019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.590023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.600666] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: IN_PROGRESS for 2s [ 1020.959247] env[69656]: INFO networking_nsxv3.common.synchronization [None req-a7bd2138-d484-43f6-abd4-6e2803b935a9 tempest-AttachVolumeTestJSON-2030714394 tempest-AttachVolumeTestJSON-2030714394-project-member] Enqueued Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGHEST for action security_group_rules [ 1020.960671] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGHEST for action security_group_rules [ 1020.964447] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.964590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.964661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.964922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.965037] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.042837] env[69656]: INFO networking_nsxv3.common.synchronization [None req-93237c8f-92f0-49da-a5d9-2fdc6ec82ef2 tempest-AttachVolumeTestJSON-2030714394 tempest-AttachVolumeTestJSON-2030714394-project-member] Enqueued Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGHEST for action security_group_rules [ 1021.043636] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGHEST for action security_group_rules [ 1021.043636] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54268a97-0553-4ee3-b6f6-8b4ef5f60202 [ 1021.043775] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.043860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.043860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.052684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.052851] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.052851] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54268a97-0553-4ee3-b6f6-8b4ef5f60202 already deleted. [ 1021.052945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54268a97-0553-4ee3-b6f6-8b4ef5f60202" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.053253] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.053349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.282945] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1021.282945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.486546] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.486694] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.486764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.486992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.487168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.487222] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 already deleted. [ 1021.487275] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.487425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.487589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.487687] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.011357] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.011691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.011691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.012058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.012058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.012058] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 already deleted. [ 1022.012185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.053195] env[69656]: INFO networking_nsxv3.common.synchronization [req-324bf68f-c698-4022-8014-6ee0c82394a9 req-d3622d8b-24fa-4493-8a70-305b5fa68efa tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1022.055143] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1022.055143] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.055327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.055327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.055479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.055639] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.055741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.055808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.055954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.056054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.056150] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.561268] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.614789] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: SUCCESS [ 1022.614789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.046319] env[69656]: INFO networking_nsxv3.common.synchronization [None req-c0367f8e-4a0b-4131-b69d-1c59bd99745a None None] Enqueued Resource ID: 4e2bb969-aad0-44e8-b1df-9b3bd25462b0 with Priority: HIGHEST for action port [ 1023.047828] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2bb969-aad0-44e8-b1df-9b3bd25462b0 with Priority: HIGHEST for action port [ 1023.048487] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e2bb969-aad0-44e8-b1df-9b3bd25462b0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.048774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e2bb969-aad0-44e8-b1df-9b3bd25462b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.048920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e2bb969-aad0-44e8-b1df-9b3bd25462b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.049496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e2bb969-aad0-44e8-b1df-9b3bd25462b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.049671] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e2bb969-aad0-44e8-b1df-9b3bd25462b0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.062688] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.554937] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e2bb969-aad0-44e8-b1df-9b3bd25462b0 [ 1023.554937] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.554937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.554937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.554937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.554937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.554937] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e2bb969-aad0-44e8-b1df-9b3bd25462b0 already deleted. [ 1023.554937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e2bb969-aad0-44e8-b1df-9b3bd25462b0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.568524] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.568524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.568524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.568524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.568524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.568524] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1023.594839] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.595227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.595407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.596078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.596362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.605728] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1025.617168] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1025.617492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.165932] env[69656]: INFO networking_nsxv3.common.synchronization [req-68720d37-6005-4e50-9c50-158877917676 req-1174e362-3737-4c77-be02-3e2dec1047b4 tempest-ServersAdminTestJSON-1828746712 tempest-ServersAdminTestJSON-1828746712-project-member] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 1027.170349] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 1027.170725] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.170855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.170942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.172573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.172797] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.172915] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.172983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.173199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.173296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.173399] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.681503] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.185218] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.687583] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.687717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.687772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.688540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.688540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.688540] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be updated. [ 1028.714561] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.714758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.714850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.715135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.715326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.724674] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 1030.736338] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 1030.736772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.352853] env[69656]: INFO networking_nsxv3.common.synchronization [req-c0ea2c76-ea4f-4e66-9cb1-18736bef0629 req-6843b090-a8c9-486b-b001-30ef5c88d7d3 tempest-ServersNegativeTestJSON-1253990888 tempest-ServersNegativeTestJSON-1253990888-project-member] Enqueued Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 1031.353422] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 1031.353743] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.353869] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.353936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.354286] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.354409] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.354510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.354615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.354719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.354813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.354923] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.859524] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.036641] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-539 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.037884] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-539" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.037884] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-539" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.038085] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-539" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.038458] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.038783] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.038898] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.039185] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.039455] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.039761] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.039948] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.040139] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.040320] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.040493] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.041160] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.041160] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.065688] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.065919] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1032.066094] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.066290] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-539" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.066609] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-bfcb7125-1e5c-4a25-89bf-1f44dfb29865 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.066791] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-bfcb7125-1e5c-4a25-89bf-1f44dfb29865" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.066914] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-bfcb7125-1e5c-4a25-89bf-1f44dfb29865" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.067464] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-bfcb7125-1e5c-4a25-89bf-1f44dfb29865" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.067464] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfcb7125-1e5c-4a25-89bf-1f44dfb29865',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.361988] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.569850] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.570358] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.570583] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.570933] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.571167] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.571454] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port bfcb7125-1e5c-4a25-89bf-1f44dfb29865 not found, creating... [ 1032.571775] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.571981] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.572158] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.572449] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.572631] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.572970] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.573272] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.573413] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.573682] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.573864] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.574043] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: bfcb7125-1e5c-4a25-89bf-1f44dfb29865 is going to be created. [ 1032.592971] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.593263] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.593419] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.593799] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.594032] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.594305] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-bfcb7125-1e5c-4a25-89bf-1f44dfb29865" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.864560] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.864928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.864928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.865061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.865123] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.865224] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7976f89e-e748-4aab-bd17-3b945c409c8c is going to be updated. [ 1032.894257] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.894545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.894545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.894720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.894896] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.908854] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: IN_PROGRESS for 2s [ 1033.479526] env[69656]: INFO networking_nsxv3.common.synchronization [req-c0ea2c76-ea4f-4e66-9cb1-18736bef0629 req-2fb6136f-8050-4387-879f-d26e98f53123 service nova] Enqueued Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_rules [ 1033.479736] env[69656]: INFO networking_nsxv3.common.synchronization [req-c0ea2c76-ea4f-4e66-9cb1-18736bef0629 req-2fb6136f-8050-4387-879f-d26e98f53123 service nova] Enqueued Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 1033.479874] env[69656]: INFO networking_nsxv3.common.synchronization [req-c0ea2c76-ea4f-4e66-9cb1-18736bef0629 req-2fb6136f-8050-4387-879f-d26e98f53123 service nova] Enqueued Resource ID: bfcb7125-1e5c-4a25-89bf-1f44dfb29865 with Priority: HIGHEST for action port [ 1033.480161] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_rules [ 1033.480299] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 1033.480401] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfcb7125-1e5c-4a25-89bf-1f44dfb29865 with Priority: HIGHEST for action port [ 1033.480960] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.483202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.483286] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.483639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.483639] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.485799] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.485799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.485799] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfcb7125-1e5c-4a25-89bf-1f44dfb29865 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.485799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfcb7125-1e5c-4a25-89bf-1f44dfb29865" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.485799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfcb7125-1e5c-4a25-89bf-1f44dfb29865" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.485799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfcb7125-1e5c-4a25-89bf-1f44dfb29865" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.485799] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfcb7125-1e5c-4a25-89bf-1f44dfb29865',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.987132] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.987565] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.987565] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfcb7125-1e5c-4a25-89bf-1f44dfb29865 with status ACTIVE [ 1033.987565] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.987778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.987778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.987954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.988044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.988263] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.988344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.988386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.988527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.988600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.988778] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.988887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.988956] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.989094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.989169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.989336] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfcb7125-1e5c-4a25-89bf-1f44dfb29865 is going to be updated. [ 1034.010367] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.010367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.010367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.010367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.010367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.010367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfcb7125-1e5c-4a25-89bf-1f44dfb29865" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.921025] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: SUCCESS [ 1034.921340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.921587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.921873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.922170] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.922337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.922448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.925341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.925341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.925341] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.431582] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.933642] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.275019] env[69656]: INFO networking_nsxv3.common.synchronization [req-20949b91-748b-4068-89dd-51753584dbe7 req-58ebfb22-7caf-4202-b9d3-1f86e1d34133 tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 with Priority: HIGHEST for action security_group_members [ 1036.275019] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 with Priority: HIGHEST for action security_group_members [ 1036.275373] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-77d2c3a5-526e-400a-8792-5423d2e6c534 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.275757] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.277085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.277085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.277085] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.277085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.277085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.277085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.277085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.277085] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77d2c3a5-526e-400a-8792-5423d2e6c534',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.436119] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.436536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.436536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.436710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.436816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.436932] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7976f89e-e748-4aab-bd17-3b945c409c8c is going to be updated. [ 1036.483166] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.483472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.483603] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.483874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.484081] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.494876] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: IN_PROGRESS for 2s [ 1036.781181] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.781373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.781536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.781877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.781953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.785689] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.785689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.785689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.785689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.785689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.785689] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 already deleted. [ 1036.785689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.087670] env[69656]: INFO networking_nsxv3.common.synchronization [req-14a07427-24c6-4d86-9956-7ad5ac0a1676 req-96373697-248b-48f3-9f5a-f68b3b54c057 tempest-ServerActionsTestOtherB-109014868 tempest-ServerActionsTestOtherB-109014868-project-member] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1037.088222] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1037.088519] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.088634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.088695] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.088889] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.091046] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.091046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.091046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.091046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.091046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.091046] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.408071] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.408071] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.408071] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.408071] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.408418] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.408641] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.408641] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.408847] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.408992] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.409219] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1037.410230] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.410230] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.410230] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.410230] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1037.410230] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.410230] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1037.430783] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.430945] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1037.431113] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.431364] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.431762] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-b3d72b8a-4a01-48a0-9de1-560ed6701f61 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.431946] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-b3d72b8a-4a01-48a0-9de1-560ed6701f61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.432085] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-b3d72b8a-4a01-48a0-9de1-560ed6701f61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.432419] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-b3d72b8a-4a01-48a0-9de1-560ed6701f61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.432566] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3d72b8a-4a01-48a0-9de1-560ed6701f61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.592497] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.592818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.592818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.592955] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.615199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.615457] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.615577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.615644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.615842] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.615925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.616038] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be updated. [ 1037.639843] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.639986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.640089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.640292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.640446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.648067] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: IN_PROGRESS for 2s [ 1037.935242] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.935576] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.935831] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.936459] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.937124] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.937124] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port b3d72b8a-4a01-48a0-9de1-560ed6701f61 not found, creating... [ 1037.937364] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.937651] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.937894] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.938308] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.938573] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.939114] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.939450] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.939638] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.940016] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.940286] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.940555] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: b3d72b8a-4a01-48a0-9de1-560ed6701f61 is going to be created. [ 1037.974890] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.975166] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.975299] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.975579] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.975811] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.976056] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-b3d72b8a-4a01-48a0-9de1-560ed6701f61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.507126] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: SUCCESS [ 1038.507404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.507677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.507944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.508182] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.508304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.508366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.508647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.508737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.508856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.508955] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.736409] env[69656]: INFO networking_nsxv3.common.synchronization [req-3fcb8e60-7845-4db9-ab71-2bd8cf341c2b req-dbe571eb-4bf7-461a-8e2a-f03fb8b1dd5b tempest-DeleteServersTestJSON-708906239 tempest-DeleteServersTestJSON-708906239-project-member] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1038.737586] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1038.737951] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.738238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.738238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.738382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.738536] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.738625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.738696] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.738833] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.738918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.739017] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.011075] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.011260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.011333] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.011605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.011774] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.011878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.011944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.012136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.012242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.012314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.012536] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.012585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.012645] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.012792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.012934] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.015103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.015103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.015103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.015103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.015103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.015103] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.160761] env[69656]: INFO networking_nsxv3.common.synchronization [req-20949b91-748b-4068-89dd-51753584dbe7 req-a68566f6-be6c-4ea3-805e-b85ddea135d4 service nova] Enqueued Resource ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 with Priority: HIGHEST for action security_group_rules [ 1039.160761] env[69656]: INFO networking_nsxv3.common.synchronization [req-20949b91-748b-4068-89dd-51753584dbe7 req-a68566f6-be6c-4ea3-805e-b85ddea135d4 service nova] Enqueued Resource ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 with Priority: HIGHEST for action security_group_members [ 1039.160761] env[69656]: INFO networking_nsxv3.common.synchronization [req-20949b91-748b-4068-89dd-51753584dbe7 req-a68566f6-be6c-4ea3-805e-b85ddea135d4 service nova] Enqueued Resource ID: b3d72b8a-4a01-48a0-9de1-560ed6701f61 with Priority: HIGHEST for action port [ 1039.160761] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 with Priority: HIGHEST for action security_group_rules [ 1039.160761] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 with Priority: HIGHEST for action security_group_members [ 1039.160761] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3d72b8a-4a01-48a0-9de1-560ed6701f61 with Priority: HIGHEST for action port [ 1039.160761] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77d2c3a5-526e-400a-8792-5423d2e6c534 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.160761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.160761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.160761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.160761] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77d2c3a5-526e-400a-8792-5423d2e6c534',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.164184] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-77d2c3a5-526e-400a-8792-5423d2e6c534 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.164459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.164614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.164868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.165115] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.165315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.165459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.165693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.165955] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.166144] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77d2c3a5-526e-400a-8792-5423d2e6c534',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.167137] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3d72b8a-4a01-48a0-9de1-560ed6701f61 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.167385] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3d72b8a-4a01-48a0-9de1-560ed6701f61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.167620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3d72b8a-4a01-48a0-9de1-560ed6701f61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.168261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3d72b8a-4a01-48a0-9de1-560ed6701f61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.168261] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3d72b8a-4a01-48a0-9de1-560ed6701f61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.243857] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.243857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.243857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.243857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.243857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.243857] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.243857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.243857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.243857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.243857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.243857] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1039.307913] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.307913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.307913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.307913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.307913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.318997] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1039.420462] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.420462] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.420462] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.420462] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.420462] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.420748] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.420853] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.421111] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.421261] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.421615] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.421765] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.421904] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.422328] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.422510] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.422668] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.422894] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.440553] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.440815] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1039.441031] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.441258] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.441633] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-14cbf9a1-a2fb-4d48-bf35-cca994d37f32 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.441856] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-14cbf9a1-a2fb-4d48-bf35-cca994d37f32" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.442033] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-14cbf9a1-a2fb-4d48-bf35-cca994d37f32" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.442376] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-14cbf9a1-a2fb-4d48-bf35-cca994d37f32" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.442593] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14cbf9a1-a2fb-4d48-bf35-cca994d37f32',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.515635] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7976f89e-e748-4aab-bd17-3b945c409c8c: rpc.has_security_group_logging(os_id): False [ 1039.532462] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.532650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.532702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.532947] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.533078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.533321] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.533454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.533523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.533721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.533898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.534119] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.534256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.534325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.534499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.534656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.534823] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.534944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.535033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.535211] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.535298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.535384] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7976f89e-e748-4aab-bd17-3b945c409c8c is going to be updated. [ 1039.591008] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.591220] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.591292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.591525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.591680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.603849] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: IN_PROGRESS for 2s [ 1039.659760] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: SUCCESS [ 1039.659760] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 deletion is rescheduled due to dependency. [ 1039.659760] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.670468] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77d2c3a5-526e-400a-8792-5423d2e6c534',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.671287] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-77d2c3a5-526e-400a-8792-5423d2e6c534 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.671287] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.674642] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3d72b8a-4a01-48a0-9de1-560ed6701f61 with status ACTIVE [ 1039.674841] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.675914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.675914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.675914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.675914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.675914] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.675914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.675914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.675914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.676573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.676573] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.676573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.676573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.676573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.676573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.676573] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3d72b8a-4a01-48a0-9de1-560ed6701f61 is going to be updated. [ 1039.699482] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.699633] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.699684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.699894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.700042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.700209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3d72b8a-4a01-48a0-9de1-560ed6701f61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.947724] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.947724] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.947724] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.947724] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.947724] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.947724] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 14cbf9a1-a2fb-4d48-bf35-cca994d37f32 not found, creating... [ 1039.947724] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.947724] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.947724] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.947724] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.947724] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.948463] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.948463] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.948463] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.948566] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.948701] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.948857] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 14cbf9a1-a2fb-4d48-bf35-cca994d37f32 is going to be created. [ 1039.970869] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.971108] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.971224] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.971529] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.971788] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.972044] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-14cbf9a1-a2fb-4d48-bf35-cca994d37f32" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.173839] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77d2c3a5-526e-400a-8792-5423d2e6c534',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.677215] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.677467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.677467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.677671] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.677759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.677874] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 is going to be created. [ 1040.702812] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.703138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.703138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.703371] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.703618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.713481] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 in Status: UNINITIALIZED for 2s [ 1040.741410] env[69656]: INFO networking_nsxv3.common.synchronization [None req-151c5702-a278-441a-be37-fe7088fb3615 None None] Enqueued Resource ID: d0d5fd5b-55c2-4442-89b3-87022a6a645c with Priority: HIGHEST for action port [ 1040.741976] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0d5fd5b-55c2-4442-89b3-87022a6a645c with Priority: HIGHEST for action port [ 1040.742298] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0d5fd5b-55c2-4442-89b3-87022a6a645c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.742415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0d5fd5b-55c2-4442-89b3-87022a6a645c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.742503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0d5fd5b-55c2-4442-89b3-87022a6a645c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.742743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0d5fd5b-55c2-4442-89b3-87022a6a645c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.742828] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0d5fd5b-55c2-4442-89b3-87022a6a645c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.102554] env[69656]: INFO networking_nsxv3.common.synchronization [req-4a4ad6ac-8667-4c91-a00e-56d59bab5a55 req-5113d88a-9b19-421e-b340-f753da2d11a8 tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: 1d9405cd-478a-474f-af17-55246ce5acfa with Priority: HIGHEST for action security_group_members [ 1041.103959] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9405cd-478a-474f-af17-55246ce5acfa with Priority: HIGHEST for action security_group_members [ 1041.104419] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9405cd-478a-474f-af17-55246ce5acfa taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.105285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.105285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.107276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.107276] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.107276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.107276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.107276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.107276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.107276] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d9405cd-478a-474f-af17-55246ce5acfa',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.246440] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0d5fd5b-55c2-4442-89b3-87022a6a645c [ 1041.246577] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.246813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.246813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.247026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.247592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.247592] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0d5fd5b-55c2-4442-89b3-87022a6a645c already deleted. [ 1041.247592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0d5fd5b-55c2-4442-89b3-87022a6a645c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.328600] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1041.328600] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 deletion is rescheduled due to dependency. [ 1041.328600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.338511] env[69656]: INFO networking_nsxv3.common.synchronization [req-3fcb8e60-7845-4db9-ab71-2bd8cf341c2b req-09c16517-3cfb-4c83-8d7f-212b0d8d8b5f service nova] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_rules [ 1041.338749] env[69656]: INFO networking_nsxv3.common.synchronization [req-3fcb8e60-7845-4db9-ab71-2bd8cf341c2b req-09c16517-3cfb-4c83-8d7f-212b0d8d8b5f service nova] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1041.338912] env[69656]: INFO networking_nsxv3.common.synchronization [req-3fcb8e60-7845-4db9-ab71-2bd8cf341c2b req-09c16517-3cfb-4c83-8d7f-212b0d8d8b5f service nova] Enqueued Resource ID: 14cbf9a1-a2fb-4d48-bf35-cca994d37f32 with Priority: HIGHEST for action port [ 1041.339185] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_rules [ 1041.339318] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1041.339426] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14cbf9a1-a2fb-4d48-bf35-cca994d37f32 with Priority: HIGHEST for action port [ 1041.340570] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.341352] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.341423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.341675] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.341760] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.345417] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.345417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.345417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.345417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.345417] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.345417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.345417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.345417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.345417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.345417] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.345906] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-14cbf9a1-a2fb-4d48-bf35-cca994d37f32 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.345906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14cbf9a1-a2fb-4d48-bf35-cca994d37f32" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.345906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14cbf9a1-a2fb-4d48-bf35-cca994d37f32" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.345906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14cbf9a1-a2fb-4d48-bf35-cca994d37f32" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.345906] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14cbf9a1-a2fb-4d48-bf35-cca994d37f32',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.610990] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.611151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.611221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.611437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.611678] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.611872] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.611971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.612046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.612237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.612275] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.612581] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d9405cd-478a-474f-af17-55246ce5acfa already deleted. [ 1041.612581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.620018] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: SUCCESS [ 1041.620194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.847748] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.847880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.848093] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.849016] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14cbf9a1-a2fb-4d48-bf35-cca994d37f32 with status ACTIVE [ 1041.849194] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.849300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.849409] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.849564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.849644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.849812] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.849900] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.849951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.850122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.850266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.850396] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.850472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.850505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.850636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.850703] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.850782] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14cbf9a1-a2fb-4d48-bf35-cca994d37f32 is going to be updated. [ 1041.874041] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.874202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.874275] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.874468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.874599] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.874755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14cbf9a1-a2fb-4d48-bf35-cca994d37f32" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.050042] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-855 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.050042] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-855" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.050042] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-855" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.050304] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-855" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.050551] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.050711] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.050830] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.051303] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.051632] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.051963] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.052119] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.052348] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.052480] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.052625] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.052745] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.052882] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.075648] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.075994] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1042.076189] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.076502] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-855" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.076998] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-921a911c-a994-4702-b015-5233b814122c taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.077253] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-921a911c-a994-4702-b015-5233b814122c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.077412] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-921a911c-a994-4702-b015-5233b814122c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.077791] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-921a911c-a994-4702-b015-5233b814122c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.078047] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('921a911c-a994-4702-b015-5233b814122c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.353611] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.580734] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.580986] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.581140] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.581446] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.581731] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.581896] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 921a911c-a994-4702-b015-5233b814122c not found, creating... [ 1042.582184] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.582377] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.582934] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.582934] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.583061] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.583258] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.583479] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.583531] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.584233] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.584233] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.584377] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 921a911c-a994-4702-b015-5233b814122c is going to be created. [ 1042.603423] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.603649] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.603783] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.604091] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.604327] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.604559] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-921a911c-a994-4702-b015-5233b814122c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.723158] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 in Status: SUCCESS [ 1042.724395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.724395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.724658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.724697] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.724826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.724897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.725080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.725165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.725254] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.725345] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77d2c3a5-526e-400a-8792-5423d2e6c534',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.855591] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.855789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.855884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.856151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.856249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.856346] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1042.884953] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.884953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.884953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.885177] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.885243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.894035] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1043.227724] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77d2c3a5-526e-400a-8792-5423d2e6c534',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.243141] env[69656]: INFO networking_nsxv3.common.synchronization [None req-76244394-1150-495e-a4ee-d72e9d9219d8 None None] Enqueued Resource ID: 04b280e8-2c64-4b6a-999b-b55d64217387 with Priority: HIGHEST for action port [ 1043.244079] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04b280e8-2c64-4b6a-999b-b55d64217387 with Priority: HIGHEST for action port [ 1043.244393] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-04b280e8-2c64-4b6a-999b-b55d64217387 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.244521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04b280e8-2c64-4b6a-999b-b55d64217387" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.244590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04b280e8-2c64-4b6a-999b-b55d64217387" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.244844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04b280e8-2c64-4b6a-999b-b55d64217387" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.244925] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04b280e8-2c64-4b6a-999b-b55d64217387',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.503939] env[69656]: INFO networking_nsxv3.common.synchronization [req-4a4ad6ac-8667-4c91-a00e-56d59bab5a55 req-6e6cb9d3-4e5e-4a26-9981-f8493cad04ba service nova] Enqueued Resource ID: 1d9405cd-478a-474f-af17-55246ce5acfa with Priority: HIGHEST for action security_group_rules [ 1043.504250] env[69656]: INFO networking_nsxv3.common.synchronization [req-4a4ad6ac-8667-4c91-a00e-56d59bab5a55 req-6e6cb9d3-4e5e-4a26-9981-f8493cad04ba service nova] Enqueued Resource ID: 1d9405cd-478a-474f-af17-55246ce5acfa with Priority: HIGHEST for action security_group_members [ 1043.504508] env[69656]: INFO networking_nsxv3.common.synchronization [req-4a4ad6ac-8667-4c91-a00e-56d59bab5a55 req-6e6cb9d3-4e5e-4a26-9981-f8493cad04ba service nova] Enqueued Resource ID: 921a911c-a994-4702-b015-5233b814122c with Priority: HIGHEST for action port [ 1043.510029] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9405cd-478a-474f-af17-55246ce5acfa with Priority: HIGHEST for action security_group_rules [ 1043.510029] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9405cd-478a-474f-af17-55246ce5acfa with Priority: HIGHEST for action security_group_members [ 1043.510029] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 921a911c-a994-4702-b015-5233b814122c with Priority: HIGHEST for action port [ 1043.510029] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d9405cd-478a-474f-af17-55246ce5acfa taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.510029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.510029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.510029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.510029] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d9405cd-478a-474f-af17-55246ce5acfa',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.510636] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9405cd-478a-474f-af17-55246ce5acfa taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.510768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.510867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.511276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.511547] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.511735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.512152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.512152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.512307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.512691] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d9405cd-478a-474f-af17-55246ce5acfa',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.513706] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-921a911c-a994-4702-b015-5233b814122c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.513922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-921a911c-a994-4702-b015-5233b814122c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.514106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-921a911c-a994-4702-b015-5233b814122c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.514479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-921a911c-a994-4702-b015-5233b814122c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.515063] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('921a911c-a994-4702-b015-5233b814122c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.730997] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77d2c3a5-526e-400a-8792-5423d2e6c534: rpc.has_security_group_logging(os_id): False [ 1043.748989] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.749445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.749600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.749833] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.749936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.750230] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.750451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.750569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.750820] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.750924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.751301] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 is going to be created. [ 1043.752798] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04b280e8-2c64-4b6a-999b-b55d64217387 [ 1043.753039] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.753183] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.753283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.753488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.753619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.753734] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04b280e8-2c64-4b6a-999b-b55d64217387 already deleted. [ 1043.753841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04b280e8-2c64-4b6a-999b-b55d64217387" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.808057] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.808221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.808302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.808512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.808706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.818494] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 in Status: IN_PROGRESS for 2s [ 1044.017603] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d9405cd-478a-474f-af17-55246ce5acfa',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.018736] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9405cd-478a-474f-af17-55246ce5acfa taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.018877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.019318] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 921a911c-a994-4702-b015-5233b814122c with status ACTIVE [ 1044.019543] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.019696] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.019815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.023014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.023014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.023014] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.023014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.023014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.023014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.023014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.023014] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.023014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.023014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.023014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.023014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.023014] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 921a911c-a994-4702-b015-5233b814122c is going to be updated. [ 1044.043409] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.043554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.043625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.043856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.044007] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.044176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-921a911c-a994-4702-b015-5233b814122c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.520548] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d9405cd-478a-474f-af17-55246ce5acfa',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.902226] env[69656]: INFO networking_nsxv3.common.synchronization [req-f0065bd8-3935-42e1-8774-67fad2b5468a req-93c19e50-d445-4f66-9b13-8f44b4df1561 tempest-ServersNegativeTestJSON-1253990888 tempest-ServersNegativeTestJSON-1253990888-project-member] Enqueued Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 1044.903410] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1044.903410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.903918] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 1044.904097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.904301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.904635] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.904635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.904635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.904794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.904870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.904967] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.905069] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.906720] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.906825] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.906881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.907043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.907195] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.907293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.907352] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.907492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.907585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.907656] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.024808] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.024808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.024808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.025321] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.025450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.025560] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d9405cd-478a-474f-af17-55246ce5acfa is going to be created. [ 1045.052804] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.052972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.053054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.053243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.053400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.063840] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d9405cd-478a-474f-af17-55246ce5acfa in Status: UNINITIALIZED for 2s [ 1045.407710] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.408080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.408080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.411722] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.411722] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.411722] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.411722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.411722] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.412331] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.830245] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 in Status: SUCCESS [ 1045.830507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.914953] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3274dea2-eaf7-4169-ba91-1154eac58032: rpc.has_security_group_logging(os_id): False [ 1045.915955] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.932536] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.932706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.932706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.932933] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.933044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.933275] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.933370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.933498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.933681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.933767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.934491] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.934491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.934491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.935088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.935176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.935368] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.935465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.935529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.935676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.935755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.935842] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1045.994844] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.995059] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.995144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.996152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.996152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.008043] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1046.418690] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.418853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.418909] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.419156] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.419263] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.419350] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7976f89e-e748-4aab-bd17-3b945c409c8c is going to be updated. [ 1046.446265] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.446452] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.446452] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.446667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.446805] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.455514] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: IN_PROGRESS for 2s [ 1047.073520] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d9405cd-478a-474f-af17-55246ce5acfa in Status: SUCCESS [ 1047.073826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.074104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.074386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.074641] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.074789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.074880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.075076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.075197] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.075334] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.075494] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d9405cd-478a-474f-af17-55246ce5acfa',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.184507] env[69656]: INFO networking_nsxv3.common.synchronization [req-fc7fbafd-4ef0-417c-a00b-488c44c2d124 req-3c3bcd0f-7b69-4875-a0ed-6b40a865591c tempest-ImagesTestJSON-514277302 tempest-ImagesTestJSON-514277302-project-member] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 1047.185016] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 1047.185735] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.185872] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.185943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.186192] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.186346] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.186450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.186513] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.186664] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.186765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.186858] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.579975] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d9405cd-478a-474f-af17-55246ce5acfa',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.689601] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.689765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.689837] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.690081] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.690178] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.690379] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.690476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.690532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.690683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.690761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.690846] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 1047.716131] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.716342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.716380] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.716666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.716734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.725581] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 1048.021098] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1048.021098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.084460] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d9405cd-478a-474f-af17-55246ce5acfa: rpc.has_security_group_logging(os_id): False [ 1048.103016] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.103185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.103350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.103460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.103549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.103789] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.103882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.103949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.104146] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.104224] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.104311] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d9405cd-478a-474f-af17-55246ce5acfa is going to be created. [ 1048.175971] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.176154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.176238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.176456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.176642] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.192100] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d9405cd-478a-474f-af17-55246ce5acfa in Status: IN_PROGRESS for 2s [ 1048.466594] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: SUCCESS [ 1048.466885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.578367] env[69656]: INFO networking_nsxv3.common.synchronization [None req-c0d7b23b-30cb-48ba-a056-582883e711d6 tempest-ServerRescueNegativeTestJSON-70641521 tempest-ServerRescueNegativeTestJSON-70641521-project-member] Enqueued Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGHEST for action security_group_rules [ 1049.578921] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGHEST for action security_group_rules [ 1049.579275] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841baacb-db1a-4155-8c56-e0d487b1795b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.579399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.579462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.579706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.579791] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841baacb-db1a-4155-8c56-e0d487b1795b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.660880] env[69656]: INFO networking_nsxv3.common.synchronization [None req-dc9e33ad-6d8e-4c60-bf36-1f829a7f67fb tempest-ServerRescueNegativeTestJSON-70641521 tempest-ServerRescueNegativeTestJSON-70641521-project-member] Enqueued Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGHEST for action security_group_rules [ 1049.661591] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGHEST for action security_group_rules [ 1049.661905] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841baacb-db1a-4155-8c56-e0d487b1795b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.662012] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.737014] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 1049.737014] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e deletion is rescheduled due to dependency. [ 1049.737014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.046378] env[69656]: INFO networking_nsxv3.common.synchronization [req-e8cbd65a-14d7-4692-936e-3934a002e7db req-4264dfd7-a428-415e-a0db-3103ac848e09 tempest-VolumesAssistedSnapshotsTest-538466738 tempest-VolumesAssistedSnapshotsTest-538466738-project-member] Enqueued Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGHEST for action security_group_members [ 1050.046863] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGHEST for action security_group_members [ 1050.047231] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb99eac5-5acc-4d01-82c2-7167ff647d1f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.047372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.047372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.048057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.048057] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.048057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.048057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.048057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.048057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.048289] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.104372] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.104372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.104372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.104372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.104372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.104372] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841baacb-db1a-4155-8c56-e0d487b1795b already deleted. [ 1050.104372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.104372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.104372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.104372] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841baacb-db1a-4155-8c56-e0d487b1795b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.207131] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d9405cd-478a-474f-af17-55246ce5acfa in Status: SUCCESS [ 1050.207131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.476151] env[69656]: INFO networking_nsxv3.common.synchronization [None req-17df2cd7-df09-40cb-ae5f-842a1120fbfb None None] Enqueued Resource ID: 2f50cfc6-dae2-4387-90ca-82a554f52103 with Priority: HIGHEST for action port [ 1050.476151] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f50cfc6-dae2-4387-90ca-82a554f52103 with Priority: HIGHEST for action port [ 1050.476151] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f50cfc6-dae2-4387-90ca-82a554f52103 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.476151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f50cfc6-dae2-4387-90ca-82a554f52103" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.476151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f50cfc6-dae2-4387-90ca-82a554f52103" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.477222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f50cfc6-dae2-4387-90ca-82a554f52103" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.477603] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f50cfc6-dae2-4387-90ca-82a554f52103',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.550743] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.553084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.553084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.553084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.573019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.573019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.573019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.573019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.573019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.573019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.573019] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f is going to be updated. [ 1050.600224] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.600224] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.600224] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.600224] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.600224] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.607468] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f in Status: IN_PROGRESS for 2s [ 1050.620970] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.620970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.620970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.620970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.620970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.620970] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841baacb-db1a-4155-8c56-e0d487b1795b already deleted. [ 1050.620970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.980397] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f50cfc6-dae2-4387-90ca-82a554f52103 [ 1050.980657] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.980804] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.980871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.981142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.981229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.981324] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f50cfc6-dae2-4387-90ca-82a554f52103 already deleted. [ 1050.981401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f50cfc6-dae2-4387-90ca-82a554f52103" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.789575] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d4972784-565f-4789-8d06-203618d09f9a tempest-AttachVolumeShelveTestJSON-958915703 tempest-AttachVolumeShelveTestJSON-958915703-project-member] Enqueued Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_rules [ 1051.790180] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_rules [ 1051.790422] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.790546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.790614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.791618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.791618] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.914537] env[69656]: INFO networking_nsxv3.common.synchronization [None req-38793429-4df5-4733-908e-76530430a872 tempest-AttachVolumeShelveTestJSON-958915703 tempest-AttachVolumeShelveTestJSON-958915703-project-member] Enqueued Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_rules [ 1051.915082] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_rules [ 1051.915395] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.915498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.310516] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.310700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.310746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.310949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.311053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.311150] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 already deleted. [ 1052.311238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.311386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.311582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.311666] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.621597] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f in Status: SUCCESS [ 1052.621808] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f deletion is rescheduled due to dependency. [ 1052.621937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.820874] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f2e008b4-0296-428c-ad76-5c49fffccf7f None None] Enqueued Resource ID: c8635ac9-a97e-477d-9326-2acddf334759 with Priority: HIGHEST for action port [ 1052.821131] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8635ac9-a97e-477d-9326-2acddf334759 with Priority: HIGHEST for action port [ 1052.821708] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8635ac9-a97e-477d-9326-2acddf334759 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.821863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8635ac9-a97e-477d-9326-2acddf334759" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.821901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8635ac9-a97e-477d-9326-2acddf334759" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.822159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8635ac9-a97e-477d-9326-2acddf334759" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.822239] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8635ac9-a97e-477d-9326-2acddf334759',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.836239] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.836528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.836624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.836826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.836919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.837024] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 already deleted. [ 1052.837111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.326479] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8635ac9-a97e-477d-9326-2acddf334759 [ 1053.326686] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.326777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.326838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.327070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.327162] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.327263] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8635ac9-a97e-477d-9326-2acddf334759 already deleted. [ 1053.327343] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8635ac9-a97e-477d-9326-2acddf334759" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.422559] env[69656]: INFO networking_nsxv3.common.synchronization [req-85a9a329-cf31-40fa-a214-09b63782fa4c req-cb260aa2-5bd7-4dec-b647-95cbb364a17f tempest-AttachInterfacesUnderV243Test-816866037 tempest-AttachInterfacesUnderV243Test-816866037-project-member] Enqueued Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 1057.423123] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 1057.423429] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.423552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.423612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.423808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.425037] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.425037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.425037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.425037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.425037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.425037] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.466518] env[69656]: INFO networking_nsxv3.common.synchronization [req-85a9a329-cf31-40fa-a214-09b63782fa4c req-cb260aa2-5bd7-4dec-b647-95cbb364a17f tempest-AttachInterfacesUnderV243Test-816866037 tempest-AttachInterfacesUnderV243Test-816866037-project-member] Enqueued Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_rules [ 1057.466518] env[69656]: INFO networking_nsxv3.common.synchronization [req-85a9a329-cf31-40fa-a214-09b63782fa4c req-cb260aa2-5bd7-4dec-b647-95cbb364a17f tempest-AttachInterfacesUnderV243Test-816866037 tempest-AttachInterfacesUnderV243Test-816866037-project-member] Enqueued Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 1057.466518] env[69656]: INFO networking_nsxv3.common.synchronization [req-85a9a329-cf31-40fa-a214-09b63782fa4c req-cb260aa2-5bd7-4dec-b647-95cbb364a17f tempest-AttachInterfacesUnderV243Test-816866037 tempest-AttachInterfacesUnderV243Test-816866037-project-member] Enqueued Resource ID: c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 with Priority: HIGHEST for action port [ 1057.466518] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_rules [ 1057.466518] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 1057.466518] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 with Priority: HIGHEST for action port [ 1057.467313] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.467589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.467878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.468207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.468395] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.469637] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.469901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.470341] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.470553] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.470707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.470962] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.472085] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0fb0727-6499-44d4-bd2d-adc12f4cb3d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.929461] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.973793] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 with status ACTIVE [ 1057.977181] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.977181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.977181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.977181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.977181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.977181] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.977181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.977181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.977181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.977181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.977181] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.977181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.977181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.977181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.977181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.977181] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 is going to be updated. [ 1057.978498] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.978780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.004851] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.004987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.005102] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.005548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.005548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.005663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.432671] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.616387] env[69656]: INFO networking_nsxv3.common.synchronization [req-005ef474-72fd-48ab-94f0-5c153b42bf4e req-81a4da0c-b322-4426-a233-bea711c2f793 tempest-AttachVolumeTestJSON-2030714394 tempest-AttachVolumeTestJSON-2030714394-project-member] Enqueued Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGHEST for action security_group_members [ 1058.617191] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGHEST for action security_group_members [ 1058.617510] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-9732c8f9-8304-4af7-9c52-c3d19cdecc90 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.617657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.617691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.617944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.618117] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.618218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.618281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.618464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.618568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.618662] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.939080] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.939309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.939412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.939708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.939866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.940024] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7521520c-f746-46f0-bf0e-85f9284fde61 is going to be updated. [ 1058.966682] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.967041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.967140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.967368] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.967514] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.975470] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7521520c-f746-46f0-bf0e-85f9284fde61 in Status: IN_PROGRESS for 2s [ 1059.122825] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.123021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.123082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.123281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.123368] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.123573] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.123674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.123737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.123888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.123981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.124053] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 already deleted. [ 1059.124131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.628217] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-150 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.628815] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-150" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.629092] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-150" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.633021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-150" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.633021] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.633021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.633021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.633021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.633021] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.633021] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.633021] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.633021] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.633021] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.633021] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.633021] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.633021] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.652521] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.652521] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1059.652521] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.652521] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-150" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.652521] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-adb08efd-6a49-4d41-bf14-2dcc411b20bb taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.652521] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-adb08efd-6a49-4d41-bf14-2dcc411b20bb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.652521] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-adb08efd-6a49-4d41-bf14-2dcc411b20bb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.652521] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-adb08efd-6a49-4d41-bf14-2dcc411b20bb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.652521] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adb08efd-6a49-4d41-bf14-2dcc411b20bb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.157154] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.157389] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.157521] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.157806] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.157953] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.158130] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port adb08efd-6a49-4d41-bf14-2dcc411b20bb not found, creating... [ 1060.158391] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.158603] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.158748] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.158972] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.160101] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.160475] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.160638] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.160756] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.160967] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.161115] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.161256] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: adb08efd-6a49-4d41-bf14-2dcc411b20bb is going to be created. [ 1060.179891] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.180164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.180256] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.180542] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.180775] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.180973] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-adb08efd-6a49-4d41-bf14-2dcc411b20bb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.986240] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7521520c-f746-46f0-bf0e-85f9284fde61 in Status: SUCCESS [ 1060.986575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.986662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.986881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.987093] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.987212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.987277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.987433] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.987581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.987618] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.059434] env[69656]: INFO networking_nsxv3.common.synchronization [req-31b7e809-ffb1-47f2-9005-e25131b04cdf req-e1f97788-024c-490f-97b8-213af14ae7ce tempest-AttachInterfacesUnderV243Test-816866037 tempest-AttachInterfacesUnderV243Test-816866037-project-member] Enqueued Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 1061.060097] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 1061.060431] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.060535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.082964] env[69656]: INFO networking_nsxv3.common.synchronization [req-31b7e809-ffb1-47f2-9005-e25131b04cdf req-e1f97788-024c-490f-97b8-213af14ae7ce tempest-AttachInterfacesUnderV243Test-816866037 tempest-AttachInterfacesUnderV243Test-816866037-project-member] Enqueued Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_rules [ 1061.083194] env[69656]: INFO networking_nsxv3.common.synchronization [req-31b7e809-ffb1-47f2-9005-e25131b04cdf req-e1f97788-024c-490f-97b8-213af14ae7ce tempest-AttachInterfacesUnderV243Test-816866037 tempest-AttachInterfacesUnderV243Test-816866037-project-member] Enqueued Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 1061.083349] env[69656]: INFO networking_nsxv3.common.synchronization [req-31b7e809-ffb1-47f2-9005-e25131b04cdf req-e1f97788-024c-490f-97b8-213af14ae7ce tempest-AttachInterfacesUnderV243Test-816866037 tempest-AttachInterfacesUnderV243Test-816866037-project-member] Enqueued Resource ID: c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 with Priority: HIGHEST for action port [ 1061.083840] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_rules [ 1061.083990] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 1061.084107] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 with Priority: HIGHEST for action port [ 1061.084384] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.084498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.084701] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.084785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.084976] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.085097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.085161] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.085370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.085446] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0fb0727-6499-44d4-bd2d-adc12f4cb3d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.184881] env[69656]: INFO networking_nsxv3.common.synchronization [req-005ef474-72fd-48ab-94f0-5c153b42bf4e req-78429a39-e9dc-415e-b097-e12d650edee3 service nova] Enqueued Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGHEST for action security_group_rules [ 1061.184881] env[69656]: INFO networking_nsxv3.common.synchronization [req-005ef474-72fd-48ab-94f0-5c153b42bf4e req-78429a39-e9dc-415e-b097-e12d650edee3 service nova] Enqueued Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGHEST for action security_group_members [ 1061.185098] env[69656]: INFO networking_nsxv3.common.synchronization [req-005ef474-72fd-48ab-94f0-5c153b42bf4e req-78429a39-e9dc-415e-b097-e12d650edee3 service nova] Enqueued Resource ID: adb08efd-6a49-4d41-bf14-2dcc411b20bb with Priority: HIGHEST for action port [ 1061.185738] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGHEST for action security_group_rules [ 1061.186026] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGHEST for action security_group_members [ 1061.186207] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb08efd-6a49-4d41-bf14-2dcc411b20bb with Priority: HIGHEST for action port [ 1061.186599] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.186663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.186736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.187008] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.187097] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.189768] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-9732c8f9-8304-4af7-9c52-c3d19cdecc90 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.189768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.189768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.189768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.192372] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.192530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.192656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.192838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.192934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.193044] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.197025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-adb08efd-6a49-4d41-bf14-2dcc411b20bb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.197025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adb08efd-6a49-4d41-bf14-2dcc411b20bb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.197025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adb08efd-6a49-4d41-bf14-2dcc411b20bb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.197025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adb08efd-6a49-4d41-bf14-2dcc411b20bb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.197025] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adb08efd-6a49-4d41-bf14-2dcc411b20bb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.491266] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.587773] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 with status ACTIVE [ 1061.588249] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.588249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.588249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.588507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.588584] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.588765] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.588876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.588962] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.589099] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.589170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.589355] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.589483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.589519] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.589702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.589777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.589864] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0fb0727-6499-44d4-bd2d-adc12f4cb3d4 is going to be updated. [ 1061.610236] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.610421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.610504] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.610750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.610936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.611174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0fb0727-6499-44d4-bd2d-adc12f4cb3d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.697908] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-9732c8f9-8304-4af7-9c52-c3d19cdecc90 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.697908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.697908] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.699497] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adb08efd-6a49-4d41-bf14-2dcc411b20bb with status ACTIVE [ 1061.699745] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.699833] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.699895] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.700110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.700324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.700679] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.700679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.700679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.700679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.700829] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.700919] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.701049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.701101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.701231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.701307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.701388] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adb08efd-6a49-4d41-bf14-2dcc411b20bb is going to be updated. [ 1061.749760] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.750136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.750136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.750343] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.750465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.750625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adb08efd-6a49-4d41-bf14-2dcc411b20bb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.994259] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.200524] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.453528] env[69656]: INFO networking_nsxv3.common.synchronization [req-76781939-a907-452e-b87d-39acb971d7e1 req-fb418e3f-8545-44c1-a23d-1f2af2bf0c72 tempest-ServersAdminTestJSON-1828746712 tempest-ServersAdminTestJSON-1828746712-project-member] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 1062.454596] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGHEST for action security_group_members [ 1062.454990] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.455134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.455204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.455400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.459477] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.459477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.459477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.459477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.459477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.459477] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.498052] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.499927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.499927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.499927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.499927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.499927] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7521520c-f746-46f0-bf0e-85f9284fde61 is going to be updated. [ 1062.528276] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.528276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.528276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.528276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.528276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.535941] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7521520c-f746-46f0-bf0e-85f9284fde61 in Status: IN_PROGRESS for 2s [ 1062.702900] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.703077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.703144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.703351] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.703437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.703538] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 is going to be created. [ 1062.729245] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.729590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.729590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.729716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.730020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.745914] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 in Status: UNINITIALIZED for 2s [ 1062.961634] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.961872] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.961953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.962221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.962342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.962501] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.962618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.962683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.962813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.962938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.962998] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be updated. [ 1063.000625] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.000994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.000994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.001577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.001577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.009948] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: IN_PROGRESS for 2s [ 1064.546282] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7521520c-f746-46f0-bf0e-85f9284fde61 in Status: SUCCESS [ 1064.548027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.548202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.548350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.548587] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.548673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.548734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.548898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.548973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.549075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.549173] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.550086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.550244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.553047] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.553047] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.553047] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.553047] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.553047] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.553047] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.756087] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 in Status: SUCCESS [ 1064.756307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.756479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.756719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.757114] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.757241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.757303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.757536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.757536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.757637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.757714] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.785272] env[69656]: INFO networking_nsxv3.common.synchronization [req-0231dea8-727d-420f-8efd-3044c0a9947a req-9077e7ac-8f11-4873-8cd0-4ef2df0b4e15 tempest-AttachInterfacesUnderV243Test-816866037 tempest-AttachInterfacesUnderV243Test-816866037-project-member] Enqueued Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 1064.786422] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7521520c-f746-46f0-bf0e-85f9284fde61 with Priority: HIGHEST for action security_group_members [ 1064.787170] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7521520c-f746-46f0-bf0e-85f9284fde61 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.787170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.023218] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 in Status: SUCCESS [ 1065.023393] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 deletion is rescheduled due to dependency. [ 1065.023505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.052506] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.054666] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.259972] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.556146] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7521520c-f746-46f0-bf0e-85f9284fde61: rpc.has_security_group_logging(os_id): False [ 1065.557308] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.576260] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.576464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.576533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.576753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.576865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.577197] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.577335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.577403] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.577551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.577645] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.577755] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7521520c-f746-46f0-bf0e-85f9284fde61 is going to be updated. [ 1065.634114] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.634418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.634418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.634589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.634767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.646067] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7521520c-f746-46f0-bf0e-85f9284fde61 in Status: IN_PROGRESS for 2s [ 1065.762282] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9732c8f9-8304-4af7-9c52-c3d19cdecc90: rpc.has_security_group_logging(os_id): False [ 1065.786971] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.786971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.786971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.786971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.786971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.786971] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.787494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.787494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.787696] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.787743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.787743] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 is going to be created. [ 1065.853791] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.853791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.853791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.854096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.854554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.863729] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 in Status: IN_PROGRESS for 2s [ 1066.060407] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.060680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.060788] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.061129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.061294] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.061434] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7521520c-f746-46f0-bf0e-85f9284fde61 is going to be updated. [ 1066.090667] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.090667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.090667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.090861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.090994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.099031] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7521520c-f746-46f0-bf0e-85f9284fde61 in Status: IN_PROGRESS for 2s [ 1067.308396] env[69656]: INFO networking_nsxv3.common.synchronization [req-923cef20-4f66-470a-bbc7-e62018b11bec req-ca85f1bb-37a7-46e5-ab0e-bc37d83c360c tempest-ServerRescueTestJSON-710259377 tempest-ServerRescueTestJSON-710259377-project-member] Enqueued Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_members [ 1067.308754] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_members [ 1067.309012] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.309147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.309233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.309454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.309604] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.309702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.309846] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.310008] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.310095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.310189] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.662218] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7521520c-f746-46f0-bf0e-85f9284fde61 in Status: SUCCESS [ 1067.662218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.662394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.663036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.663036] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.786788] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-360 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.787035] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-360" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.787154] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-360" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.787491] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-360" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.787772] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.787957] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.788093] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.788310] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.788558] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.788669] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.788786] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.788902] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.789296] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.789296] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.789296] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.789517] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.810894] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.811169] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1067.811439] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.811662] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-360" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.812018] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.812210] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.812335] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.812689] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.812852] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.813726] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.813836] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.813905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.814121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.814204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.814378] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.814469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.814529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.814670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.814744] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.814825] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 already deleted. [ 1067.814901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.880097] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 in Status: SUCCESS [ 1067.880331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.109316] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7521520c-f746-46f0-bf0e-85f9284fde61 in Status: IN_PROGRESS for 4s [ 1068.183642] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.183879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.183879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.186072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.186225] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.186339] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7521520c-f746-46f0-bf0e-85f9284fde61 is going to be deleted. [ 1068.243281] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.243506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.243506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.243701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.243789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.243850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.316962] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.316962] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.317446] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.317446] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.317710] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.317911] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503 not found, creating... [ 1068.318294] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.318514] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.318668] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.318973] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.319175] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.319463] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.319631] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.319954] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.320076] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.320280] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.320345] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503 is going to be created. [ 1068.349555] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.349787] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.349920] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.350235] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.350475] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.350727] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.100362] env[69656]: INFO networking_nsxv3.common.synchronization [req-ad37f597-0684-40ce-af2d-0e6cc2f452f7 req-c1844b34-6d9f-4a3a-a089-4a4eb1aa26cd tempest-DeleteServersTestJSON-708906239 tempest-DeleteServersTestJSON-708906239-project-member] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1069.100914] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1069.101319] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.101404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.101462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.101608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.101758] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.101858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.101932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.102085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.102174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.102264] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.233245] env[69656]: INFO networking_nsxv3.common.synchronization [req-923cef20-4f66-470a-bbc7-e62018b11bec req-bb335c38-c9d1-45fc-9508-a0e92b209b62 service nova] Enqueued Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_rules [ 1069.233245] env[69656]: INFO networking_nsxv3.common.synchronization [req-923cef20-4f66-470a-bbc7-e62018b11bec req-bb335c38-c9d1-45fc-9508-a0e92b209b62 service nova] Enqueued Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_members [ 1069.233245] env[69656]: INFO networking_nsxv3.common.synchronization [req-923cef20-4f66-470a-bbc7-e62018b11bec req-bb335c38-c9d1-45fc-9508-a0e92b209b62 service nova] Enqueued Resource ID: d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503 with Priority: HIGHEST for action port [ 1069.233245] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_rules [ 1069.233245] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_members [ 1069.233245] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503 with Priority: HIGHEST for action port [ 1069.233245] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.233245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.233245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.233245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.233672] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.234775] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.234998] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.235179] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.235422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.235659] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.236405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.237783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.237783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.237783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.237783] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.237995] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.238324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.238324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.238324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.238423] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.605016] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.605342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.605342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.605456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.605552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.605749] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.605844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.605902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.606065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.606137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.606221] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1069.633291] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.633460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.633526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.633667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.633795] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.641545] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1069.740602] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.740737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.740947] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.742053] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503 with status ACTIVE [ 1069.742130] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.742206] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.742252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.742839] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.742839] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.742839] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.742839] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.743091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.743091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.743157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.743467] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.743467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.743467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.743684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.743684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.743774] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503 is going to be updated. [ 1069.767563] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.767702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.767779] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.767986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.768141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.768302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3fbf8b3-06ca-4d34-8728-b1ecaa4b9503" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.118919] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7521520c-f746-46f0-bf0e-85f9284fde61 in Status: SUCCESS [ 1070.119169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.119337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.119567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.119834] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.119969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.120050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.120214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.120295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.122032] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.246224] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.623520] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.623812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.623812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.623965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.624114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.625029] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.625029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.625029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.625029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.625029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.625029] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7521520c-f746-46f0-bf0e-85f9284fde61 is going to be deleted. [ 1070.653080] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.653226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.653296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.653502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.653593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.653694] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.655279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.655322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.655487] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.655591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.655655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.655813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.655863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.655952] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7521520c-f746-46f0-bf0e-85f9284fde61',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.750037] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.750037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.750037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.750037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.750037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.750037] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 is going to be created. [ 1070.774131] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.774323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.774429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.774680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.774855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.785083] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: UNINITIALIZED for 2s [ 1071.159848] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.160112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.160234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.160431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.160548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.160696] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.160827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.160893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.161084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.161141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.161229] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7521520c-f746-46f0-bf0e-85f9284fde61 already deleted. [ 1071.161310] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7521520c-f746-46f0-bf0e-85f9284fde61" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.652272] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1071.652565] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 deletion is rescheduled due to dependency. [ 1071.652565] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.794500] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: SUCCESS [ 1072.794766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.794965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.795254] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.795521] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.796278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.796444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.796621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.796708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.797427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.797427] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.301664] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.301813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.303157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.303157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.303157] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.303157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.303157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.303157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.303157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.303415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.303597] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.303729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.303792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.303943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.304219] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.304358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.304484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.304741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.304893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.305024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.305157] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.781626] env[69656]: INFO networking_nsxv3.common.synchronization [req-6d6e2689-d639-4908-853a-5d8f7f4a2a01 req-1ce6aa4b-4193-4251-aece-515422ef587b tempest-ImagesTestJSON-514277302 tempest-ImagesTestJSON-514277302-project-member] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 1073.782368] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 1073.785017] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.785017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.785017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.785017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.785017] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.785017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.785017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.785017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.785017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.785017] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.809090] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb962a91-1fd6-476a-900f-fb50bdf4b147: rpc.has_security_group_logging(os_id): False [ 1073.825862] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.826045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.826045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.826254] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.826371] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.826613] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.826759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.826838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.827012] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.829113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.829113] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.829113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.829113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.829113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.829113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.829113] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.829113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.829113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.831295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.831383] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.831465] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 is going to be created. [ 1073.888073] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.888231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.888297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.888491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.888666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.907282] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: IN_PROGRESS for 2s [ 1074.287469] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.287639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.287710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.287937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.288104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.288371] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.288453] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.288488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.288673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.288742] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.288842] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 1074.314931] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.315133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.315223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.315463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.315602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.323772] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 1074.335598] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.335683] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.335764] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.336048] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.336334] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.336500] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.336621] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.336843] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.336994] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.337224] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.337339] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.337450] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.337552] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.337678] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.337789] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.337923] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.355852] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.356061] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1074.356209] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.356386] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-665" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.356683] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-a3a836de-4620-4773-beef-8de31686fabb taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.356858] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-a3a836de-4620-4773-beef-8de31686fabb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.356984] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-a3a836de-4620-4773-beef-8de31686fabb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.357339] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-a3a836de-4620-4773-beef-8de31686fabb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.357484] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3a836de-4620-4773-beef-8de31686fabb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.860866] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.861290] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.861460] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.861929] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.862034] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.862196] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port a3a836de-4620-4773-beef-8de31686fabb not found, creating... [ 1074.862507] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.862692] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.862835] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.863107] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.863290] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.863622] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.864180] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.864180] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.864298] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.864403] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.864551] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: a3a836de-4620-4773-beef-8de31686fabb is going to be created. [ 1074.884317] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.884548] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.884690] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.884999] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.885267] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.885514] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-a3a836de-4620-4773-beef-8de31686fabb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.737527] env[69656]: INFO networking_nsxv3.common.synchronization [req-6d6e2689-d639-4908-853a-5d8f7f4a2a01 req-0e24390f-08c6-420b-9cd6-ace79155ff20 service nova] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_rules [ 1075.737826] env[69656]: INFO networking_nsxv3.common.synchronization [req-6d6e2689-d639-4908-853a-5d8f7f4a2a01 req-0e24390f-08c6-420b-9cd6-ace79155ff20 service nova] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 1075.738091] env[69656]: INFO networking_nsxv3.common.synchronization [req-6d6e2689-d639-4908-853a-5d8f7f4a2a01 req-0e24390f-08c6-420b-9cd6-ace79155ff20 service nova] Enqueued Resource ID: a3a836de-4620-4773-beef-8de31686fabb with Priority: HIGHEST for action port [ 1075.738852] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_rules [ 1075.738958] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 1075.739170] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3a836de-4620-4773-beef-8de31686fabb with Priority: HIGHEST for action port [ 1075.739524] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.739700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.739802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.740122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.740253] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.741748] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.741847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.742070] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3a836de-4620-4773-beef-8de31686fabb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.742176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3a836de-4620-4773-beef-8de31686fabb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.742238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3a836de-4620-4773-beef-8de31686fabb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.742410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3a836de-4620-4773-beef-8de31686fabb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.742487] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3a836de-4620-4773-beef-8de31686fabb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.920756] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: SUCCESS [ 1075.921169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.243987] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.244145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.246654] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3a836de-4620-4773-beef-8de31686fabb with status ACTIVE [ 1076.246968] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.247203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.247312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.251058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.251058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.251058] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.251058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.251058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.251058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.251058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.251058] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.251058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.251058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.251058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.251058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.251058] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3a836de-4620-4773-beef-8de31686fabb is going to be updated. [ 1076.270159] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.270374] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.270477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.270751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.270946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.271196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3a836de-4620-4773-beef-8de31686fabb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.332803] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 1076.332988] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e deletion is rescheduled due to dependency. [ 1076.333120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.333285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.333553] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.333743] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.333860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.333926] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.334095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.334176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.334273] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.837397] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.340081] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.844118] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.844355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.844433] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.844710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.844843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.845022] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 1077.871405] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.871558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.871636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.871843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.872034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.879978] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 1079.892090] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 1079.892090] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.896242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.896242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.896242] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.896242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.896242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.896242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.896242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.896242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.896242] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.261741] env[69656]: INFO networking_nsxv3.common.synchronization [req-a76534e1-f02f-47ad-b303-3449acb9dc2d req-c236c41f-c619-48e0-b9ee-0c5f65667b0d tempest-ServerRescueNegativeTestJSON-70641521 tempest-ServerRescueNegativeTestJSON-70641521-project-member] Enqueued Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGHEST for action security_group_members [ 1080.262535] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGHEST for action security_group_members [ 1080.262899] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-841baacb-db1a-4155-8c56-e0d487b1795b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.263125] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.263222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.266485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.266485] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.266485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.266485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.266485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.266485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.266485] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841baacb-db1a-4155-8c56-e0d487b1795b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.396578] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.396797] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.396797] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.396974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.397181] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.397280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.397341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.397492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.397578] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.397665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.397812] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.397923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.397961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.398102] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.398238] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.398369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.398419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.398517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.398591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.398687] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.398758] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.768647] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.768839] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.769245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.769245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.769430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.769560] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.769687] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.769749] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.769948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.770086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.770214] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841baacb-db1a-4155-8c56-e0d487b1795b already deleted. [ 1080.770575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.836695] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.836880] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-357" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.837017] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-357" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.837295] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-357" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.837560] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.837974] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.837974] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.838105] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.838197] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.838397] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.838514] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.838625] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.838734] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.838891] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.838959] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.839098] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.857051] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.857237] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1080.857355] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.857528] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-357" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.857819] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-86de2103-dfa5-447e-83c1-acab8c9e4407 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.857985] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-86de2103-dfa5-447e-83c1-acab8c9e4407" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.858241] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-86de2103-dfa5-447e-83c1-acab8c9e4407" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.858430] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-86de2103-dfa5-447e-83c1-acab8c9e4407" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.858572] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86de2103-dfa5-447e-83c1-acab8c9e4407',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.907916] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a714e7c-1123-47f3-81e4-70f097603f3e: rpc.has_security_group_logging(os_id): False [ 1080.924985] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.925145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.925232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.925491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.925586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.925786] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.925886] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.925952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.926115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.926194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.926394] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.926486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.926546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.926681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.926754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.926931] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.927070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.927130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.927303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.927413] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.927413] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 1080.986253] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.986384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.987026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.987026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.987026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.997185] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 1081.361202] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.361452] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.361566] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.361863] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.362118] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.362314] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 86de2103-dfa5-447e-83c1-acab8c9e4407 not found, creating... [ 1081.362588] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.362753] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.362873] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.363143] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.363286] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.363577] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.363778] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.363926] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.364064] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.364198] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.364351] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 86de2103-dfa5-447e-83c1-acab8c9e4407 is going to be created. [ 1081.382678] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.382924] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.383113] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.383859] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.384154] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.384407] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-86de2103-dfa5-447e-83c1-acab8c9e4407" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.671593] env[69656]: INFO networking_nsxv3.common.synchronization [req-a76534e1-f02f-47ad-b303-3449acb9dc2d req-ab921e3b-5b4e-4e2e-897c-5e221da4bdef service nova] Enqueued Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGHEST for action security_group_rules [ 1082.671593] env[69656]: INFO networking_nsxv3.common.synchronization [req-a76534e1-f02f-47ad-b303-3449acb9dc2d req-ab921e3b-5b4e-4e2e-897c-5e221da4bdef service nova] Enqueued Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGHEST for action security_group_members [ 1082.671593] env[69656]: INFO networking_nsxv3.common.synchronization [req-a76534e1-f02f-47ad-b303-3449acb9dc2d req-ab921e3b-5b4e-4e2e-897c-5e221da4bdef service nova] Enqueued Resource ID: 86de2103-dfa5-447e-83c1-acab8c9e4407 with Priority: HIGHEST for action port [ 1082.671593] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGHEST for action security_group_rules [ 1082.671593] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGHEST for action security_group_members [ 1082.671593] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86de2103-dfa5-447e-83c1-acab8c9e4407 with Priority: HIGHEST for action port [ 1082.671593] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841baacb-db1a-4155-8c56-e0d487b1795b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.671593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.676783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.676783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.676783] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841baacb-db1a-4155-8c56-e0d487b1795b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.676969] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-841baacb-db1a-4155-8c56-e0d487b1795b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.677953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.678071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.678289] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.678495] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.678636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.678723] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.679257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.681021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.681021] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841baacb-db1a-4155-8c56-e0d487b1795b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.681888] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-86de2103-dfa5-447e-83c1-acab8c9e4407 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.682022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86de2103-dfa5-447e-83c1-acab8c9e4407" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.682151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86de2103-dfa5-447e-83c1-acab8c9e4407" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.682252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86de2103-dfa5-447e-83c1-acab8c9e4407" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.682327] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86de2103-dfa5-447e-83c1-acab8c9e4407',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.011205] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 1083.011205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.016157] env[69656]: INFO networking_nsxv3.common.synchronization [req-50388e74-daea-47b2-832e-c14b86a71696 req-2e708635-e9c2-4e77-ba38-89321adb1eb8 tempest-AttachVolumeShelveTestJSON-958915703 tempest-AttachVolumeShelveTestJSON-958915703-project-member] Enqueued Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_members [ 1083.016711] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_members [ 1083.017170] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.020020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.020020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.020020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.020020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.020020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.020540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.020540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.020540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.020540] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.187622] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-841baacb-db1a-4155-8c56-e0d487b1795b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.187622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.187622] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('841baacb-db1a-4155-8c56-e0d487b1795b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.187622] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86de2103-dfa5-447e-83c1-acab8c9e4407 with status ACTIVE [ 1083.187622] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.187622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.187622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.187622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.187622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.187622] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.187622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.187622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.187622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.187622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.191246] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.191246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.191246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.191246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.191246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.191246] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86de2103-dfa5-447e-83c1-acab8c9e4407 is going to be updated. [ 1083.210121] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.210121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.210121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.210121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.210121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.210521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86de2103-dfa5-447e-83c1-acab8c9e4407" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.525051] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.525051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.525051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.525051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.525051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.525051] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.525051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.525051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.525051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.525051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.525458] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 already deleted. [ 1083.525458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.638922] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-152 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.639153] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.639287] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.639590] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.639849] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.640013] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.642644] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.643558] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.643797] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.644397] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.645944] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.646099] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.646235] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.646366] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.646485] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.646630] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.664629] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.665775] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1083.665775] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.665775] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.665775] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-df0faae1-9447-43e7-9ebd-353219d3f5c5 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.665775] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.665775] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.666371] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.666371] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df0faae1-9447-43e7-9ebd-353219d3f5c5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.692639] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('841baacb-db1a-4155-8c56-e0d487b1795b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.171714] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.172008] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.172436] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.172805] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.172974] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.173187] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port df0faae1-9447-43e7-9ebd-353219d3f5c5 not found, creating... [ 1084.175358] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.175542] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.175672] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.175912] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.176074] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.176380] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.176547] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.176669] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.176881] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.180249] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.180462] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: df0faae1-9447-43e7-9ebd-353219d3f5c5 is going to be created. [ 1084.196450] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.196450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.196450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.196450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.196450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.196450] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841baacb-db1a-4155-8c56-e0d487b1795b is going to be created. [ 1084.201185] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.202738] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.202738] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.202738] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.202738] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.202738] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.224658] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.225185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.225185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.225185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.225349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.235964] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841baacb-db1a-4155-8c56-e0d487b1795b in Status: UNINITIALIZED for 2s [ 1084.969838] env[69656]: INFO networking_nsxv3.common.synchronization [req-50388e74-daea-47b2-832e-c14b86a71696 req-ad2d9eba-214f-452f-82ce-2a2def88fa62 service nova] Enqueued Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_rules [ 1084.970128] env[69656]: INFO networking_nsxv3.common.synchronization [req-50388e74-daea-47b2-832e-c14b86a71696 req-ad2d9eba-214f-452f-82ce-2a2def88fa62 service nova] Enqueued Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_members [ 1084.970194] env[69656]: INFO networking_nsxv3.common.synchronization [req-50388e74-daea-47b2-832e-c14b86a71696 req-ad2d9eba-214f-452f-82ce-2a2def88fa62 service nova] Enqueued Resource ID: df0faae1-9447-43e7-9ebd-353219d3f5c5 with Priority: HIGHEST for action port [ 1084.970402] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_rules [ 1084.971585] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_members [ 1084.971585] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0faae1-9447-43e7-9ebd-353219d3f5c5 with Priority: HIGHEST for action port [ 1084.971585] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.972455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.972455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.972455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.972455] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.972874] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.972994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.973119] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.973296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.973447] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.973543] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.973599] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.973732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.974081] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.974081] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.974734] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-df0faae1-9447-43e7-9ebd-353219d3f5c5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.974848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.974909] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.975056] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.975182] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df0faae1-9447-43e7-9ebd-353219d3f5c5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.477105] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.480346] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.480521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.480777] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df0faae1-9447-43e7-9ebd-353219d3f5c5 with status ACTIVE [ 1085.481056] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.481246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.481420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.482046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.482046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.482046] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.482242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.482242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.482484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.482615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.482906] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.483074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.483179] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.483408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.483581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.483686] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df0faae1-9447-43e7-9ebd-353219d3f5c5 is going to be updated. [ 1085.503675] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.503907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.504118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.504615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.504790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.505018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.986484] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.246492] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841baacb-db1a-4155-8c56-e0d487b1795b in Status: SUCCESS [ 1086.246586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.246778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.246946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.247166] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.247307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.247407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.247642] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.247737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.247827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.247923] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('841baacb-db1a-4155-8c56-e0d487b1795b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.491137] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.491232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.491344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.491598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.491598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.491720] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 is going to be created. [ 1086.520165] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.520283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.520345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.520574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.520736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.532366] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 in Status: UNINITIALIZED for 2s [ 1086.700559] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.700770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.700846] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.701093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.701229] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.752334] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('841baacb-db1a-4155-8c56-e0d487b1795b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.759642] env[69656]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1086.762754] env[69656]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1086.881726] env[69656]: INFO networking_nsxv3.common.synchronization [req-89708ad9-44b3-406b-967b-a51c3b219f97 req-19e8182d-a7e2-4363-9adc-e0b15b79c6fc tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1086.882550] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1086.884919] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.885157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.885283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.885616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.885912] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.886098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.887631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.887973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.888147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.891363] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.203633] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.253079] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 841baacb-db1a-4155-8c56-e0d487b1795b: rpc.has_security_group_logging(os_id): False [ 1087.275186] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.275467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.275467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.275632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.275732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.275977] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.276152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.276152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.276353] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.276443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.276523] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841baacb-db1a-4155-8c56-e0d487b1795b is going to be created. [ 1087.331729] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.331995] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.331995] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.332311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.332514] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.342715] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841baacb-db1a-4155-8c56-e0d487b1795b in Status: IN_PROGRESS for 2s [ 1087.394025] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.606636] env[69656]: INFO networking_nsxv3.common.synchronization [req-8e9e628d-faf6-4c8b-a3c7-feae9122414c req-36c22e43-df05-4ab1-8889-48389564b7f0 tempest-ServersTestFqdnHostnames-735452098 tempest-ServersTestFqdnHostnames-735452098-project-member] Enqueued Resource ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf with Priority: HIGHEST for action security_group_members [ 1087.607205] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf with Priority: HIGHEST for action security_group_members [ 1087.607776] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.607776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.607776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.607986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.608226] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.612077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.612077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.612077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.612077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.612077] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.706607] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.897936] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.069735] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.070011] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.070192] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.070515] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.070841] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.071078] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.071245] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.071524] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.071716] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.071968] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1088.072187] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.072253] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.072347] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.072465] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1088.072575] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.072707] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.093524] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.093774] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1088.093961] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.094200] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.094582] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.094766] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.094889] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.095235] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.095374] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.110695] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.110841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.110946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.111156] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.111278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.111540] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.111674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.111749] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.111910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.111989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.112176] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf is going to be updated. [ 1088.135684] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.135891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.135981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.136237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.136383] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.145507] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf in Status: IN_PROGRESS for 2s [ 1088.209711] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1088.209711] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1088.403079] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.403312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.403417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.403646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.403739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.403842] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1088.435869] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.436109] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.436210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.436482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.436668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.445393] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1088.543478] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 in Status: SUCCESS [ 1088.543770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.543985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.544219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.544503] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.544609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.544808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.544878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.544974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.545090] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.545185] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.599135] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.599411] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.599542] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.599830] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.599981] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.600193] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef not found, creating... [ 1088.600478] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.600640] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.600760] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.600991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.601146] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.601434] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.601586] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.601702] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.601908] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.602836] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.603087] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef is going to be created. [ 1088.630474] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.630703] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.631103] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.631197] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.631508] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.632321] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.048814] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.158223] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.158529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.158529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.158830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.182857] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1089.183130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.185283] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1089.237737] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.238123] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.238123] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.238227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.256479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.257010] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1089.257107] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1089.257258] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1089.301065] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.301358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.301358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.301520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.303563] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.303971] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1089.353874] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841baacb-db1a-4155-8c56-e0d487b1795b in Status: SUCCESS [ 1089.353874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.374481] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.374749] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.374749] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.374898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.375276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.375544] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1089.448202] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.448363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.448430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.448660] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.448948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.449304] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:40. [ 1089.449402] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'753a0574-7bcf-4133-85db-b811b57f750a', '0ed397b9-8a6a-442e-a200-45439f9f86d9', '4dd4ac7d-9012-443c-9954-5ea006504e81', '22763ac9-09b1-45ba-b8a9-6df4fc54e141', 'a33f9cc8-ecf3-4437-910b-83546eec0eb5', 'eb99eac5-5acc-4d01-82c2-7167ff647d1f', 'fcdf0196-2f66-4c44-9bd4-b05de185002c', 'e79ef0da-74c8-48fe-99d7-25b720dd4847', 'ceadc5a6-0e5a-4475-96ab-3f4a1cec315b', 'b629ee2e-0b52-4f1a-9ab3-28190008dec5', 'e7af54d8-7472-45f1-aeff-b4e7f22e3f8a', '520db785-680d-4180-b916-bfbc19204d31', '5f636061-691e-4a7a-a595-1723a2745695', 'be49990d-ddef-4039-b2ad-187913e6ad02', '7cc9edd3-ec13-4776-b83d-312440c75c07', '9732c8f9-8304-4af7-9c52-c3d19cdecc90', 'fb962a91-1fd6-476a-900f-fb50bdf4b147', 'e5c76201-04fa-4fa1-bd82-b1756116b4c4', 'cbab9cac-0394-407c-b39a-2ca9394c8a11', '7976f89e-e748-4aab-bd17-3b945c409c8c', '759da36a-a18b-4f5f-b889-a6d7444033f4', '6d9740de-f67c-4fbd-a249-44afc4caaef1', 'e7c27843-e365-4bd4-9103-dc94b0c2a637', '06966f07-554f-446e-a2a7-17a62c52a519', '3746f1b2-61cd-415b-a74b-1d4da3f9731f', '841baacb-db1a-4155-8c56-e0d487b1795b', '3274dea2-eaf7-4169-ba91-1154eac58032', '792b043f-2560-4918-890f-99f50b059db4', '0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b', 'c35bc1ec-d02e-41f7-b05b-c27e0d977c43', '037b783b-a9e4-4669-8461-2452a42615e1', 'fe7fb2d8-2929-4f36-a2da-bafb532a875d', '3a714e7c-1123-47f3-81e4-70f097603f3e', '77d2c3a5-526e-400a-8792-5423d2e6c534', '8e938057-3189-4358-8ca5-5e18d05bbddf', '4a133f47-cf05-42f1-8365-6a566b72e14d', '1d9405cd-478a-474f-af17-55246ce5acfa', 'a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf', 'f3521005-0bf3-4791-8930-fe6bb6c94423', '8a9ee1b5-46c4-4ea5-a724-f697a2014dcb'} {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1089.449500] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1089.487714] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.487891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.487941] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.488248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.488408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.488486] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1089.488523] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1089.488643] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1089.551768] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0b372e3-dc4f-48b1-9e79-f3de5b63e563: rpc.has_security_group_logging(os_id): False [ 1089.570638] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.570838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.570838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.571063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.572185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.572459] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1089.572539] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1089.572612] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1089.572675] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1089.572754] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/40 resources of Type:Security Group Rules [ 1089.572826] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 753a0574-7bcf-4133-85db-b811b57f750a with Priority: HIGH for action security_group_rules [ 1089.572936] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGH for action security_group_rules [ 1089.573159] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 with Priority: HIGH for action security_group_rules [ 1089.573159] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGH for action security_group_rules [ 1089.573159] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGH for action security_group_rules [ 1089.573159] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGH for action security_group_rules [ 1089.573395] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGH for action security_group_rules [ 1089.573395] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGH for action security_group_rules [ 1089.573395] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGH for action security_group_rules [ 1089.573395] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGH for action security_group_rules [ 1089.573602] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGH for action security_group_rules [ 1089.573602] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGH for action security_group_rules [ 1089.573602] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGH for action security_group_rules [ 1089.573740] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be49990d-ddef-4039-b2ad-187913e6ad02 with Priority: HIGH for action security_group_rules [ 1089.573740] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 with Priority: HIGH for action security_group_rules [ 1089.573740] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGH for action security_group_rules [ 1089.573893] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGH for action security_group_rules [ 1089.573893] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGH for action security_group_rules [ 1089.573975] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 with Priority: HIGH for action security_group_rules [ 1089.573975] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGH for action security_group_rules [ 1089.574097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.575154] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.575283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.575339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.575532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.575612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.575846] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.575940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.576011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.576208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.576287] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.576375] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 is going to be created. [ 1089.631351] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.634027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.634027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.634027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.634027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.643254] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 in Status: IN_PROGRESS for 2s [ 1089.912713] env[69656]: INFO networking_nsxv3.common.synchronization [req-89708ad9-44b3-406b-967b-a51c3b219f97 req-d53f6904-2c78-4edb-ba75-4db3053d9d02 service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 1089.912955] env[69656]: INFO networking_nsxv3.common.synchronization [req-89708ad9-44b3-406b-967b-a51c3b219f97 req-d53f6904-2c78-4edb-ba75-4db3053d9d02 service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1089.913170] env[69656]: INFO networking_nsxv3.common.synchronization [req-89708ad9-44b3-406b-967b-a51c3b219f97 req-d53f6904-2c78-4edb-ba75-4db3053d9d02 service nova] Enqueued Resource ID: 85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef with Priority: HIGHEST for action port [ 1089.913812] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 1089.913988] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1089.914344] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef with Priority: HIGHEST for action port [ 1089.914344] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 753a0574-7bcf-4133-85db-b811b57f750a with Priority: HIGH for action security_group_rules [ 1089.914589] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 with Priority: HIGH for action security_group_rules [ 1089.914589] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdf0196-2f66-4c44-9bd4-b05de185002c with Priority: HIGH for action security_group_rules [ 1089.914722] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 with Priority: HIGH for action security_group_rules [ 1089.914722] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGH for action security_group_rules [ 1089.914844] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 with Priority: HIGH for action security_group_rules [ 1089.914953] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 with Priority: HIGH for action security_group_rules [ 1089.915078] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGH for action security_group_rules [ 1089.915219] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be49990d-ddef-4039-b2ad-187913e6ad02 with Priority: HIGH for action security_group_rules [ 1089.915437] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGH for action security_group_rules [ 1089.915437] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f636061-691e-4a7a-a595-1723a2745695 with Priority: HIGH for action security_group_rules [ 1089.915581] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGH for action security_group_rules [ 1089.915639] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGH for action security_group_rules [ 1089.915714] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 with Priority: HIGH for action security_group_rules [ 1089.915826] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGH for action security_group_rules [ 1089.915919] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f with Priority: HIGH for action security_group_rules [ 1089.916039] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 with Priority: HIGH for action security_group_rules [ 1089.916152] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 with Priority: HIGH for action security_group_rules [ 1089.916267] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGH for action security_group_rules [ 1089.916360] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 with Priority: HIGH for action security_group_rules [ 1089.916800] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.916928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.917319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.917754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.917919] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.919060] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.919188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.919429] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.919540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.919631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.919951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.919951] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.921471] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-753a0574-7bcf-4133-85db-b811b57f750a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.921985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.922167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.922400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.922483] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('753a0574-7bcf-4133-85db-b811b57f750a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.923324] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dd4ac7d-9012-443c-9954-5ea006504e81 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.923418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.923480] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.926215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.926215] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dd4ac7d-9012-443c-9954-5ea006504e81',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.926215] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcdf0196-2f66-4c44-9bd4-b05de185002c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.926215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.926215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.926215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.926215] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcdf0196-2f66-4c44-9bd4-b05de185002c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.926215] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cc9edd3-ec13-4776-b83d-312440c75c07 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.926801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.926801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.927106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.927296] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cc9edd3-ec13-4776-b83d-312440c75c07',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.928485] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.928658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.928751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.928920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.928989] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.930676] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbab9cac-0394-407c-b39a-2ca9394c8a11 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.930821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.930921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.931384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.931508] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbab9cac-0394-407c-b39a-2ca9394c8a11',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.933758] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.933758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.933758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.933981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.933981] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5c76201-04fa-4fa1-bd82-b1756116b4c4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.939243] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.939243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.939243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.939243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.939243] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.939607] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be49990d-ddef-4039-b2ad-187913e6ad02 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.939722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.939778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.941241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.941386] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be49990d-ddef-4039-b2ad-187913e6ad02',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.943144] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.943144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.943411] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.943583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.943654] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.944843] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f636061-691e-4a7a-a595-1723a2745695 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.944954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.945030] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.945186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.945258] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f636061-691e-4a7a-a595-1723a2745695',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.946569] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-520db785-680d-4180-b916-bfbc19204d31 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.946696] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.946754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.946885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.946955] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.948454] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.948864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.948864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.952187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.952187] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.952187] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.952187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.952187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.952187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.952187] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b629ee2e-0b52-4f1a-9ab3-28190008dec5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.952187] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.952187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.952187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.952187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.952187] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.952187] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.952187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.952187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.952187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.952187] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb99eac5-5acc-4d01-82c2-7167ff647d1f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.952939] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e79ef0da-74c8-48fe-99d7-25b720dd4847 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.959019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.959019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.959019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.959019] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e79ef0da-74c8-48fe-99d7-25b720dd4847',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.959019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.959019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.959019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.959019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.959019] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a33f9cc8-ecf3-4437-910b-83546eec0eb5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.959019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.959639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.959639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.959639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.959639] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.960992] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.960992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.961186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.961186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.961294] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22763ac9-09b1-45ba-b8a9-6df4fc54e141',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.992511] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.992651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.992716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.992932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.996272] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.996413] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.997315] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.997434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.018215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.018354] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbab9cac-0394-407c-b39a-2ca9394c8a11 is going to be deleted. [ 1090.019424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.019632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.041882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.042073] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cc9edd3-ec13-4776-b83d-312440c75c07 is going to be deleted. [ 1090.043024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.043239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.060165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.060296] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcdf0196-2f66-4c44-9bd4-b05de185002c is going to be deleted. [ 1090.067903] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.068048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.068114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.068326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.068410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.068522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbab9cac-0394-407c-b39a-2ca9394c8a11" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.092911] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.093789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.094311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.095353] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.095422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.095500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cc9edd3-ec13-4776-b83d-312440c75c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.111020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.111020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.111020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.111020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.111020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.111020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcdf0196-2f66-4c44-9bd4-b05de185002c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.164176] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf in Status: SUCCESS [ 1090.164395] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf deletion is rescheduled due to dependency. [ 1090.164530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.445698] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-9732c8f9-8304-4af7-9c52-c3d19cdecc90 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.446026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.446026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.446198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.446432] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.446432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.446657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.446657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.446657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.446841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.446841] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.450031] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-520db785-680d-4180-b916-bfbc19204d31 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.451850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.451850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.451850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.451850] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.451850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.451850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.451850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.451850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.451850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.451850] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.460780] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1090.460994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.461889] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.462502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.462502] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.462645] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.462748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.462949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.463051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.463164] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.468178] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.468295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.468364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.468536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.468690] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.468792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.468854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.469187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.469576] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.469674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.469768] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.470622] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.471121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.471121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.471121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.471121] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.471302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.471302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.471423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.471488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.471566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.472086] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.473766] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.474203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.474203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.474323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.474526] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.474630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.474695] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.474861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.474907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.474988] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.475085] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.479378] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.479378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.479530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.480263] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.480961] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.481056] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.485646] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.486274] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.486350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.486534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.486692] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.486792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.486855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.486998] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.487095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.487191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.487469] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.487563] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.487626] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.487766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.487905] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.487989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.488060] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.488213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.488290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.488370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.488454] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.490536] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.490536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.490536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.490536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.490686] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.490686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.490759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.493581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.493581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.493581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.493581] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.493918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.493918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.494077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.494323] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.495039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.495039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.495039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.495039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.495039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.495039] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.498333] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.498476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.498518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.498817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.499163] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.499163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.499278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.499350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.499435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.499561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.499652] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.500403] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef with status ACTIVE [ 1090.500600] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.500702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.500765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.500912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.500987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.501163] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.501519] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.501587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.503590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.503590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.503590] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.503590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.503590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.503590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.503590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.503590] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef is going to be updated. [ 1090.504677] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.504769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.510425] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7af54d8-7472-45f1-aeff-b4e7f22e3f8a: rpc.has_security_group_logging(os_id): False [ 1090.512768] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7976f89e-e748-4aab-bd17-3b945c409c8c: rpc.has_security_group_logging(os_id): False [ 1090.556091] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.556091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.556518] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.556518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.557083] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.557196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.557959] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.557959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.562212] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.562341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.563723] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.563723] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.563895] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.563957] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.564745] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.564840] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.565578] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.565691] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be49990d-ddef-4039-b2ad-187913e6ad02 is going to be deleted. [ 1090.567241] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.567355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.567481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.567640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.569418] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.569521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.572136] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.572136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.572558] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1090.573016] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.579029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.579029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.579029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.579029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.579029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85c5d2ca-010e-4d0b-b8a1-9f2b0ecc9fef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.591977] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1090.592774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.593064] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be deleted. [ 1090.594424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.596035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.627985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.628132] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dd4ac7d-9012-443c-9954-5ea006504e81 is going to be deleted. [ 1090.629186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.629425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.631855] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.632016] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.683988] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.683988] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.686348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.686479] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b629ee2e-0b52-4f1a-9ab3-28190008dec5 is going to be deleted. [ 1090.687441] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.687653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.809218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.809483] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb99eac5-5acc-4d01-82c2-7167ff647d1f is going to be deleted. [ 1090.810475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.810691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.857945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.858178] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22763ac9-09b1-45ba-b8a9-6df4fc54e141 is going to be deleted. [ 1090.859235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.859463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.865350] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.865874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.909924] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.909924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.918248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.918415] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a33f9cc8-ecf3-4437-910b-83546eec0eb5 is going to be deleted. [ 1090.919609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.919715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.951105] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.955312] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.961947] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.962118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.964442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.964679] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5c76201-04fa-4fa1-bd82-b1756116b4c4 is going to be deleted. [ 1090.965766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.965979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.983715] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.983874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.984228] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.984339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.984404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.984610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.984754] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.984900] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.984985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.985291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.985411] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.985536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.985787] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.985933] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.986058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.986313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.986529] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.986674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.986799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.986983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.987128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.987271] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.987421] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.988316] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.015724] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.015870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.015932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.016173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.016351] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.016448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.016509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.016655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.016737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.016822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.016962] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.017071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.017129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.017333] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.017401] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.017488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.017544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.017672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.017742] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.017818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.017902] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.027283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.027360] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e79ef0da-74c8-48fe-99d7-25b720dd4847 is going to be deleted. [ 1091.028208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.028405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.062117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.062301] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.062591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.062591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.063113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.063214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.063404] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.063526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.063648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.063739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.063811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.063988] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.064085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.064151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.064288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.064362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.064454] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a is going to be updated. [ 1091.065476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.065633] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.074497] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.074663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.096113] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.096254] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.140020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.140020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.140435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.140592] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f636061-691e-4a7a-a595-1723a2745695 is going to be deleted. [ 1091.142451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.142702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.214160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.214382] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 753a0574-7bcf-4133-85db-b811b57f750a is going to be deleted. [ 1091.215413] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.218239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.218239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.218239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be49990d-ddef-4039-b2ad-187913e6ad02" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.218239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.218239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.218239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.218239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.220429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.220679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.220733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.220813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dd4ac7d-9012-443c-9954-5ea006504e81" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.220991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.221509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.221759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.223136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b629ee2e-0b52-4f1a-9ab3-28190008dec5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.223408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.223565] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.223651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.223772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb99eac5-5acc-4d01-82c2-7167ff647d1f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.223904] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.224063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.224185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.224246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22763ac9-09b1-45ba-b8a9-6df4fc54e141" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.224365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.224534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.239133] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.239133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.260917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.261306] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.261394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.261394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.261586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.261724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.261939] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.262065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.262146] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.262312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.262388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.262570] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.262650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.262762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.262866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.262902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.262990] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7976f89e-e748-4aab-bd17-3b945c409c8c is going to be updated. [ 1091.266693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.266874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.266960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.267213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5c76201-04fa-4fa1-bd82-b1756116b4c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.267295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.267396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.267472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.267580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a33f9cc8-ecf3-4437-910b-83546eec0eb5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.267793] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.269616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.269616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.269616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e79ef0da-74c8-48fe-99d7-25b720dd4847" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.269616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.269616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.269616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.272507] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.273376] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.273489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.273654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.277067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.277067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f636061-691e-4a7a-a595-1723a2745695" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.289124] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: IN_PROGRESS for 2s [ 1091.316689] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.316689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.316689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.316689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.316689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.316689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-753a0574-7bcf-4133-85db-b811b57f750a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.377460] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1091.378230] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.378442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.378609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.379145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.379145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.411389] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: IN_PROGRESS for 2s [ 1091.453265] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9732c8f9-8304-4af7-9c52-c3d19cdecc90: rpc.has_security_group_logging(os_id): False [ 1091.458803] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 520db785-680d-4180-b916-bfbc19204d31: rpc.has_security_group_logging(os_id): False [ 1091.481109] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.481390] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.485028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.485028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.485028] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.485028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.490206] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ceadc5a6-0e5a-4475-96ab-3f4a1cec315b: rpc.has_security_group_logging(os_id): False [ 1091.491260] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.510393] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.510567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.512078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.512924] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.512924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.512924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.512924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.512924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.513173] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 520db785-680d-4180-b916-bfbc19204d31 is going to be updated. [ 1091.514382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.514382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.524701] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb962a91-1fd6-476a-900f-fb50bdf4b147: rpc.has_security_group_logging(os_id): False [ 1091.537576] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.538085] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.538190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.538335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.538606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.538783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.538833] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 is going to be updated. [ 1091.542308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.542308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.543328] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.543328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.560020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.560020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.560020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.560020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.560020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.560020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.560020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.560020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.560020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.560020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.560020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.560929] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.560929] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.560929] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.560929] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.560929] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.560929] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 1091.561821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.562017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.574098] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.574256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.579794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.580108] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.580218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.580299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.580866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.580866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.580866] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.581843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.581843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.581843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.581843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.581843] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.581843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.581843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.581843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.582137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.582137] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 is going to be updated. [ 1091.583425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.583782] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.583969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.594828] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 520db785-680d-4180-b916-bfbc19204d31 in Status: IN_PROGRESS for 2s [ 1091.604295] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.604516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.604683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.605111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.605210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.626114] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 in Status: IN_PROGRESS for 2s [ 1091.648985] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.648985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.648985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.648985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.648985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.654237] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.654237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.654237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.654237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.654237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.682422] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 in Status: SUCCESS [ 1091.682658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.683715] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 1091.684744] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: IN_PROGRESS for 2s [ 1091.994769] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.994984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.995072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.995331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.995469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.995623] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1092.028916] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.028916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.028916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.028916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.028916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.036791] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1092.797926] env[69656]: INFO networking_nsxv3.common.synchronization [req-951c9154-3ce2-4929-a52b-ab001ea2ec09 req-06cf9320-108c-42cd-8861-7eb7196a1a30 tempest-ServerActionsTestOtherB-109014868 tempest-ServerActionsTestOtherB-109014868-project-member] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1092.799871] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1092.799871] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.799871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.799871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.799871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.799871] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.799871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.799871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.799871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.799871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.800233] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.303943] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.304115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.304181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.304885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.304885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.304885] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.304885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.305838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.306062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.306214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.306250] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be deleted. [ 1093.308593] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: SUCCESS [ 1093.308696] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.333051] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.333350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.333425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.333697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.333832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.333940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.430494] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: SUCCESS [ 1093.430935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.545085] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.545085] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.545085] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.545085] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.545085] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.545085] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.545085] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.545844] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.546156] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.546502] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.546791] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.547408] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.547637] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.547934] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.548195] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.548531] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.569061] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.572164] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1093.572164] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.572164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.572164] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-734afd19-47ee-4004-a980-8b05d5761bbb taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.572164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-734afd19-47ee-4004-a980-8b05d5761bbb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.572164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-734afd19-47ee-4004-a980-8b05d5761bbb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.574213] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-734afd19-47ee-4004-a980-8b05d5761bbb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.574213] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('734afd19-47ee-4004-a980-8b05d5761bbb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.607039] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 520db785-680d-4180-b916-bfbc19204d31 in Status: SUCCESS [ 1093.607039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.637590] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 in Status: SUCCESS [ 1093.637590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.702917] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: SUCCESS [ 1093.703257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.704176] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 1093.704394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.048491] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1094.048853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.048853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.049149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.049461] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.049578] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.049578] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.049790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.049887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.050095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.050189] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.075161] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.075496] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.075628] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.075897] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.076071] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.076269] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 734afd19-47ee-4004-a980-8b05d5761bbb not found, creating... [ 1094.076941] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.076941] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.076941] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.077205] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.077320] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.077708] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.077810] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.078661] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.078661] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.078661] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.078815] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 734afd19-47ee-4004-a980-8b05d5761bbb is going to be created. [ 1094.104376] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.104580] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.104765] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.104999] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.105302] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.105535] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-734afd19-47ee-4004-a980-8b05d5761bbb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.108250] env[69656]: INFO networking_nsxv3.common.synchronization [None req-25729b37-809f-4f6c-9409-ae7e0c3e06d8 tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 with Priority: HIGHEST for action security_group_rules [ 1094.109054] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 with Priority: HIGHEST for action security_group_rules [ 1094.109332] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0e73dee-afe4-4a44-9672-c68cc0af0557 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.109454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.109515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.109795] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.109887] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0e73dee-afe4-4a44-9672-c68cc0af0557',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.394980] env[69656]: INFO networking_nsxv3.common.synchronization [None req-2b96ec4b-ffb8-4167-b626-4d5acf4b7477 tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 with Priority: HIGHEST for action security_group_rules [ 1094.396053] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 with Priority: HIGHEST for action security_group_rules [ 1094.396877] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0e73dee-afe4-4a44-9672-c68cc0af0557 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.397047] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.556662] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.556662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.556662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.556662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.556662] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.556662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.556662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.556662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.557428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.557428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.557428] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.557428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.557428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.557428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.557681] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.557681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.557681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.557979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.557979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.557979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.558195] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.630564] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.630564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.630564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.630818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.630876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.631427] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 already deleted. [ 1094.632070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.632070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.632070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.632070] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0e73dee-afe4-4a44-9672-c68cc0af0557',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.643493] env[69656]: INFO networking_nsxv3.common.synchronization [None req-6e4edaf8-b3ef-4de9-961d-475c843031cc None None] Enqueued Resource ID: 3e152165-31ee-46c9-92e2-fd40d1bb8c07 with Priority: HIGHEST for action port [ 1094.643493] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e152165-31ee-46c9-92e2-fd40d1bb8c07 with Priority: HIGHEST for action port [ 1094.643493] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e152165-31ee-46c9-92e2-fd40d1bb8c07 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.643493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e152165-31ee-46c9-92e2-fd40d1bb8c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.643493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e152165-31ee-46c9-92e2-fd40d1bb8c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.643493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e152165-31ee-46c9-92e2-fd40d1bb8c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.643493] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e152165-31ee-46c9-92e2-fd40d1bb8c07',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.061097] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06966f07-554f-446e-a2a7-17a62c52a519: rpc.has_security_group_logging(os_id): False [ 1095.080913] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.080913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.082622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.082622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.101398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.101652] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.101772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.101845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.102064] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.102168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.102469] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.102564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.102564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.102714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.102783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.102991] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.103102] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.103176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.103348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.103424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.103510] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1095.144432] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e152165-31ee-46c9-92e2-fd40d1bb8c07 [ 1095.144432] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.144432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.144432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.145199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.145199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.145199] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e152165-31ee-46c9-92e2-fd40d1bb8c07 already deleted. [ 1095.145199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e152165-31ee-46c9-92e2-fd40d1bb8c07" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.152184] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.152184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.152184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.152184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.152471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.152471] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 already deleted. [ 1095.152471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.162890] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.162890] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.162890] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.163147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.163405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.175925] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1095.979094] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d0080802-63bf-42fd-a40d-69914dd36d1a None None] Enqueued Resource ID: 5b188f48-bd51-4887-a333-425aac65767e with Priority: HIGHEST for action port [ 1095.979094] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b188f48-bd51-4887-a333-425aac65767e with Priority: HIGHEST for action port [ 1095.979420] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b188f48-bd51-4887-a333-425aac65767e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.979560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b188f48-bd51-4887-a333-425aac65767e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.979645] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b188f48-bd51-4887-a333-425aac65767e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.979975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b188f48-bd51-4887-a333-425aac65767e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.980094] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b188f48-bd51-4887-a333-425aac65767e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.194718] env[69656]: INFO networking_nsxv3.common.synchronization [req-daf9312d-57c0-4b51-b638-aca500e2b82b req-6ddee087-bed2-415d-9fbc-5aaa7de145f9 tempest-ImagesTestJSON-514277302 tempest-ImagesTestJSON-514277302-project-member] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 1096.194718] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGHEST for action security_group_members [ 1096.194718] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.194718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.194718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.194718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.194718] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.194718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.194718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.194718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.194718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.194718] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.291445] env[69656]: INFO networking_nsxv3.common.synchronization [req-951c9154-3ce2-4929-a52b-ab001ea2ec09 req-73968eba-94e3-40d7-bb05-0548751ac069 service nova] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_rules [ 1096.291620] env[69656]: INFO networking_nsxv3.common.synchronization [req-951c9154-3ce2-4929-a52b-ab001ea2ec09 req-73968eba-94e3-40d7-bb05-0548751ac069 service nova] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1096.291832] env[69656]: INFO networking_nsxv3.common.synchronization [req-951c9154-3ce2-4929-a52b-ab001ea2ec09 req-73968eba-94e3-40d7-bb05-0548751ac069 service nova] Enqueued Resource ID: 734afd19-47ee-4004-a980-8b05d5761bbb with Priority: HIGHEST for action port [ 1096.292330] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_rules [ 1096.292477] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1096.292564] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734afd19-47ee-4004-a980-8b05d5761bbb with Priority: HIGHEST for action port [ 1096.292836] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.292959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.293459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.293766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.293849] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.294735] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.294858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.294916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.295143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.295302] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.295398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.295459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.295605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.298824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.298824] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.298824] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-734afd19-47ee-4004-a980-8b05d5761bbb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.298824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-734afd19-47ee-4004-a980-8b05d5761bbb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.298824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-734afd19-47ee-4004-a980-8b05d5761bbb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.298824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-734afd19-47ee-4004-a980-8b05d5761bbb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.298824] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('734afd19-47ee-4004-a980-8b05d5761bbb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.487586] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b188f48-bd51-4887-a333-425aac65767e [ 1096.487803] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.487964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.488039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.488290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.488381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.488482] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b188f48-bd51-4887-a333-425aac65767e already deleted. [ 1096.488580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b188f48-bd51-4887-a333-425aac65767e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.583632] env[69656]: INFO networking_nsxv3.common.synchronization [req-bc31efad-9e50-43ac-beb0-6f72d5b1add5 req-0e23af81-21c7-4567-bc08-a517c5893fe9 tempest-ServersAdminNegativeTestJSON-2005902791 tempest-ServersAdminNegativeTestJSON-2005902791-project-member] Enqueued Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_members [ 1096.583937] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_members [ 1096.584300] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.584423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.584500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.584971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.585152] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.585249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.585373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.585511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.585585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.585682] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.694882] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d5cb0954-604b-4118-b497-09b1c49b81c3 None None] Enqueued Resource ID: d41c7183-3564-4bb5-b39f-226c6d55b2c5 with Priority: HIGHEST for action port [ 1096.695588] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41c7183-3564-4bb5-b39f-226c6d55b2c5 with Priority: HIGHEST for action port [ 1096.697415] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-d41c7183-3564-4bb5-b39f-226c6d55b2c5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.697415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d41c7183-3564-4bb5-b39f-226c6d55b2c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.697415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d41c7183-3564-4bb5-b39f-226c6d55b2c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.697415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d41c7183-3564-4bb5-b39f-226c6d55b2c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.697415] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d41c7183-3564-4bb5-b39f-226c6d55b2c5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.698191] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.701495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.701495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.701495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.722592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.722592] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.724620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.724620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.724620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.724620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.724620] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be updated. [ 1096.747028] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.747197] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.747270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.748060] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.748060] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.755586] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: IN_PROGRESS for 2s [ 1096.802270] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.802270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.802270] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 734afd19-47ee-4004-a980-8b05d5761bbb with status ACTIVE [ 1096.802270] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.802270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.802661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.802661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.802661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.803111] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.803111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.803111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.803111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.803362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.803362] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.803457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.803531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.803672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.803752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.803834] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 734afd19-47ee-4004-a980-8b05d5761bbb is going to be updated. [ 1096.805028] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.823516] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.824349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.824451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.824720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.824935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.825107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-734afd19-47ee-4004-a980-8b05d5761bbb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.071364] env[69656]: INFO networking_nsxv3.common.synchronization [req-6eeb1410-863f-41a8-9b12-77987243d765 req-6746a59d-fe36-425e-908a-124fa1566909 tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: 1d9405cd-478a-474f-af17-55246ce5acfa with Priority: HIGHEST for action security_group_members [ 1097.071771] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9405cd-478a-474f-af17-55246ce5acfa with Priority: HIGHEST for action security_group_members [ 1097.074141] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d9405cd-478a-474f-af17-55246ce5acfa taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.074141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.074141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.074141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.074141] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.074670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.074670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.074670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.074670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.074670] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d9405cd-478a-474f-af17-55246ce5acfa',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.088184] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.088331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.088386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.088827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.088827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.088937] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.088993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.089110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.089567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.089656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.089747] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d70c367d-ca7b-45b3-9579-5b05739f400a already deleted. [ 1097.089825] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.193485] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1097.193700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.201201] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d41c7183-3564-4bb5-b39f-226c6d55b2c5 [ 1097.201509] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.201581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.201631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.201817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.201900] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.201992] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d41c7183-3564-4bb5-b39f-226c6d55b2c5 already deleted. [ 1097.202081] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d41c7183-3564-4bb5-b39f-226c6d55b2c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.307626] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.577179] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.580069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.580069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.580069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.616652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.616652] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.616652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.616652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.616652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.616652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.616652] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d9405cd-478a-474f-af17-55246ce5acfa is going to be updated. [ 1097.653025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.653025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.653025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.653025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.653025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.663360] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d9405cd-478a-474f-af17-55246ce5acfa in Status: IN_PROGRESS for 2s [ 1097.814170] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.814170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.814170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.814170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.814170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.814170] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be created. [ 1097.839299] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.839299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.839299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.839299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.839299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.852796] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: UNINITIALIZED for 2s [ 1097.964899] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.965576] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.965576] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.965576] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.965829] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.966557] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.966770] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.967083] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.967715] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.968023] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1097.968201] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1097.969449] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1097.969829] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1097.970163] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1097.970412] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1097.970617] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1097.992064] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1097.992647] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1097.992722] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1097.992886] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.993403] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-da6c9f13-ca83-4289-9998-ca23eda6068e taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.993518] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-da6c9f13-ca83-4289-9998-ca23eda6068e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.993582] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-da6c9f13-ca83-4289-9998-ca23eda6068e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.993952] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-da6c9f13-ca83-4289-9998-ca23eda6068e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.994712] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da6c9f13-ca83-4289-9998-ca23eda6068e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.500062] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.500062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.500062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.500062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.500062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.500062] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port da6c9f13-ca83-4289-9998-ca23eda6068e not found, creating... [ 1098.500062] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.500062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.500062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.500062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.500062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.500951] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.503567] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.503567] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.503567] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.503567] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.503567] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: da6c9f13-ca83-4289-9998-ca23eda6068e is going to be created. [ 1098.524283] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.524283] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.524283] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.524283] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.524283] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.524283] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-da6c9f13-ca83-4289-9998-ca23eda6068e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.765944] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a714e7c-1123-47f3-81e4-70f097603f3e in Status: SUCCESS [ 1098.766759] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e deletion is rescheduled due to dependency. [ 1098.766759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.487374] env[69656]: INFO networking_nsxv3.common.synchronization [None req-58325656-a291-4eb2-b902-10329e2044f3 None None] Enqueued Resource ID: 4faf4d0d-523f-4fc7-925b-1a2460fccad6 with Priority: HIGHEST for action port [ 1099.488547] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4faf4d0d-523f-4fc7-925b-1a2460fccad6 with Priority: HIGHEST for action port [ 1099.488547] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-4faf4d0d-523f-4fc7-925b-1a2460fccad6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.488547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4faf4d0d-523f-4fc7-925b-1a2460fccad6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.488547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4faf4d0d-523f-4fc7-925b-1a2460fccad6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.488730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4faf4d0d-523f-4fc7-925b-1a2460fccad6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.488811] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4faf4d0d-523f-4fc7-925b-1a2460fccad6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.673775] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d9405cd-478a-474f-af17-55246ce5acfa in Status: SUCCESS [ 1099.674133] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d9405cd-478a-474f-af17-55246ce5acfa deletion is rescheduled due to dependency. [ 1099.674167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d9405cd-478a-474f-af17-55246ce5acfa" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.861433] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: SUCCESS [ 1099.861660] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.861811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.862029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.862291] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.862959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.863094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.863318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.863679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.863853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.863994] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.991283] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4faf4d0d-523f-4fc7-925b-1a2460fccad6 [ 1099.991522] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.991744] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.991744] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.991930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.992035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.992134] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4faf4d0d-523f-4fc7-925b-1a2460fccad6 already deleted. [ 1099.992268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4faf4d0d-523f-4fc7-925b-1a2460fccad6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.369634] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.386510] env[69656]: INFO networking_nsxv3.common.synchronization [req-bc31efad-9e50-43ac-beb0-6f72d5b1add5 req-bf6eff52-f509-40c1-9bfb-b2feea9c71fb service nova] Enqueued Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_rules [ 1100.386510] env[69656]: INFO networking_nsxv3.common.synchronization [req-bc31efad-9e50-43ac-beb0-6f72d5b1add5 req-bf6eff52-f509-40c1-9bfb-b2feea9c71fb service nova] Enqueued Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_members [ 1100.386510] env[69656]: INFO networking_nsxv3.common.synchronization [req-bc31efad-9e50-43ac-beb0-6f72d5b1add5 req-bf6eff52-f509-40c1-9bfb-b2feea9c71fb service nova] Enqueued Resource ID: da6c9f13-ca83-4289-9998-ca23eda6068e with Priority: HIGHEST for action port [ 1100.386510] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_rules [ 1100.386510] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_members [ 1100.386510] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da6c9f13-ca83-4289-9998-ca23eda6068e with Priority: HIGHEST for action port [ 1100.386510] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.386510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.386510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.387012] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.387012] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.389202] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.389202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.389202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.389202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.389202] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.389575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.389575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.389736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.389862] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.390309] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.391729] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-da6c9f13-ca83-4289-9998-ca23eda6068e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.391866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da6c9f13-ca83-4289-9998-ca23eda6068e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.391957] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da6c9f13-ca83-4289-9998-ca23eda6068e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.392157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da6c9f13-ca83-4289-9998-ca23eda6068e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.392337] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da6c9f13-ca83-4289-9998-ca23eda6068e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.501935] env[69656]: INFO networking_nsxv3.common.synchronization [req-cdc4ce34-5c86-45cc-823e-5cb4ffe9271a req-e181ecb1-fb94-4e52-bec5-a71ee87996a2 tempest-SecurityGroupRulesNegativeTestJSON-733295958 tempest-SecurityGroupRulesNegativeTestJSON-733295958-project-member] Enqueued Resource ID: d317176a-8d58-473e-9da8-597c5ab962a0 with Priority: HIGHEST for action security_group_rules [ 1100.501935] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d317176a-8d58-473e-9da8-597c5ab962a0 with Priority: HIGHEST for action security_group_rules [ 1100.504640] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d317176a-8d58-473e-9da8-597c5ab962a0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.504640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d317176a-8d58-473e-9da8-597c5ab962a0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.504640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d317176a-8d58-473e-9da8-597c5ab962a0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.504640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d317176a-8d58-473e-9da8-597c5ab962a0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.504640] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d317176a-8d58-473e-9da8-597c5ab962a0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.871540] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ed397b9-8a6a-442e-a200-45439f9f86d9: rpc.has_security_group_logging(os_id): False [ 1100.896039] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.896039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.896039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.896039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.896039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.896039] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.896039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.896039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.896039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.896039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.896039] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be created. [ 1100.896998] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.898276] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.898536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.898808] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da6c9f13-ca83-4289-9998-ca23eda6068e with status ACTIVE [ 1100.899071] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.899289] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.899492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.899780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.899971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.900276] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.900551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.907429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.907429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.907429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.907429] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.907429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.907429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.907429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.907429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.907429] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da6c9f13-ca83-4289-9998-ca23eda6068e is going to be updated. [ 1100.930613] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.930613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.930613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.930613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.931714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.932681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da6c9f13-ca83-4289-9998-ca23eda6068e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.974027] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.974027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.974027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.974027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.974027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.991825] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: IN_PROGRESS for 2s [ 1101.037061] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.037061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.037061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.037061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.037061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.037061] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d317176a-8d58-473e-9da8-597c5ab962a0 already deleted. [ 1101.037061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d317176a-8d58-473e-9da8-597c5ab962a0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.408151] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.515361] env[69656]: INFO networking_nsxv3.common.synchronization [None req-4342ba11-8ea3-4f3c-91ba-e3c222615659 tempest-ServerDiskConfigTestJSON-2110996415 tempest-ServerDiskConfigTestJSON-2110996415-project-member] Enqueued Resource ID: 7671f2ea-7c25-4efc-8ff5-e5135dd20d56 with Priority: HIGHEST for action security_group_rules [ 1101.515962] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7671f2ea-7c25-4efc-8ff5-e5135dd20d56 with Priority: HIGHEST for action security_group_rules [ 1101.516359] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7671f2ea-7c25-4efc-8ff5-e5135dd20d56 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.516496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7671f2ea-7c25-4efc-8ff5-e5135dd20d56" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.516566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7671f2ea-7c25-4efc-8ff5-e5135dd20d56" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.516836] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7671f2ea-7c25-4efc-8ff5-e5135dd20d56" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.516921] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7671f2ea-7c25-4efc-8ff5-e5135dd20d56',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.591726] env[69656]: INFO networking_nsxv3.common.synchronization [None req-627b823d-a4ca-4818-9799-ce54f8897ca1 tempest-ServerDiskConfigTestJSON-2110996415 tempest-ServerDiskConfigTestJSON-2110996415-project-member] Enqueued Resource ID: 7671f2ea-7c25-4efc-8ff5-e5135dd20d56 with Priority: HIGHEST for action security_group_rules [ 1101.592144] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7671f2ea-7c25-4efc-8ff5-e5135dd20d56 with Priority: HIGHEST for action security_group_rules [ 1101.592515] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7671f2ea-7c25-4efc-8ff5-e5135dd20d56 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.592632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7671f2ea-7c25-4efc-8ff5-e5135dd20d56" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.758692] env[69656]: INFO networking_nsxv3.common.synchronization [req-83abd55f-0684-4833-a34a-defce03e5809 req-6f618871-8218-4a33-b6ba-aa3b1d5e2a75 tempest-SecurityGroupRulesNegativeTestJSON-733295958 tempest-SecurityGroupRulesNegativeTestJSON-733295958-project-member] Enqueued Resource ID: d317176a-8d58-473e-9da8-597c5ab962a0 with Priority: HIGHEST for action security_group_rules [ 1101.759288] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d317176a-8d58-473e-9da8-597c5ab962a0 with Priority: HIGHEST for action security_group_rules [ 1101.759601] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d317176a-8d58-473e-9da8-597c5ab962a0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.759722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d317176a-8d58-473e-9da8-597c5ab962a0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.759776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d317176a-8d58-473e-9da8-597c5ab962a0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.760181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d317176a-8d58-473e-9da8-597c5ab962a0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.760438] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d317176a-8d58-473e-9da8-597c5ab962a0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.912998] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.913324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.913324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.913494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.913586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.913700] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d70c367d-ca7b-45b3-9579-5b05739f400a is going to be created. [ 1101.937868] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.938044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.938077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.938307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.938469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.951922] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: UNINITIALIZED for 2s [ 1102.038015] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.038256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.038256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.039516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.040205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.040205] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7671f2ea-7c25-4efc-8ff5-e5135dd20d56 already deleted. [ 1102.040205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7671f2ea-7c25-4efc-8ff5-e5135dd20d56" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.040378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7671f2ea-7c25-4efc-8ff5-e5135dd20d56" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.040553] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7671f2ea-7c25-4efc-8ff5-e5135dd20d56" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.040647] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7671f2ea-7c25-4efc-8ff5-e5135dd20d56',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.279683] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.279861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.280265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.281095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.281209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.281356] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d317176a-8d58-473e-9da8-597c5ab962a0 already deleted. [ 1102.281418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d317176a-8d58-473e-9da8-597c5ab962a0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.570146] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.570344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.570428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.570659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.570746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.570839] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7671f2ea-7c25-4efc-8ff5-e5135dd20d56 already deleted. [ 1102.570920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7671f2ea-7c25-4efc-8ff5-e5135dd20d56" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.921134] env[69656]: INFO networking_nsxv3.common.synchronization [req-0e8ef35d-0629-4b29-bc7b-e6443b7d2c57 req-4d6f8df7-c1bd-47c7-9b2a-ccf7445b8739 tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1102.925827] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1102.925923] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.926181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.926261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.926509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.926721] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.926820] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.926887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.927061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.927148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.927243] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.015828] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: SUCCESS [ 1103.016070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.430086] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.773441] env[69656]: INFO networking_nsxv3.common.synchronization [None req-b96c9397-8df2-430f-9af5-ebac7f69df13 None None] Enqueued Resource ID: 0dc7feb9-6076-4df9-81c8-130d3fafaad6 with Priority: HIGHEST for action port [ 1103.773441] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc7feb9-6076-4df9-81c8-130d3fafaad6 with Priority: HIGHEST for action port [ 1103.773441] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-0dc7feb9-6076-4df9-81c8-130d3fafaad6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.773441] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0dc7feb9-6076-4df9-81c8-130d3fafaad6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.773441] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0dc7feb9-6076-4df9-81c8-130d3fafaad6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.773615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0dc7feb9-6076-4df9-81c8-130d3fafaad6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.773687] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dc7feb9-6076-4df9-81c8-130d3fafaad6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.936552] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.963634] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: SUCCESS [ 1103.966454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.966454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.966454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.966746] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.966906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.966959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.967198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.967306] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.967986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.968297] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.276286] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0dc7feb9-6076-4df9-81c8-130d3fafaad6 [ 1104.279432] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.279432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.279432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.279432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.279432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.279432] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0dc7feb9-6076-4df9-81c8-130d3fafaad6 already deleted. [ 1104.279432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0dc7feb9-6076-4df9-81c8-130d3fafaad6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.438784] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.442169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.442329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.442572] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.442662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.442770] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1104.469388] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.469806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.469806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.469806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.469951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.471248] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.471355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.471757] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.471757] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.471757] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.471913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.471913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.473019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.473019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.473019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.473019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.473019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.473019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.473019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.473019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.473019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.473019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.473342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.473342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.473342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.473342] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.481348] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1104.979867] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d70c367d-ca7b-45b3-9579-5b05739f400a: rpc.has_security_group_logging(os_id): False [ 1105.000599] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.000754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.000825] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.001063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.001566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.001566] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.001566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.001566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.001863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.001863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.002571] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.002571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.002571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.002571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.002571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.002571] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.002571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.002945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.002945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.002945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.002945] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d70c367d-ca7b-45b3-9579-5b05739f400a is going to be created. [ 1105.065138] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.065138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.065138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.065138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.065138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.072923] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: IN_PROGRESS for 2s [ 1105.643321] env[69656]: INFO networking_nsxv3.common.synchronization [req-7547bd3d-575b-47ed-9f2c-f05dcfc14db6 req-8a0cb2df-bb22-4ddd-adc2-37dc85ff36f3 tempest-ServerDiskConfigTestJSON-2110996415 tempest-ServerDiskConfigTestJSON-2110996415-project-member] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1105.643875] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1105.644199] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.644322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.644380] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.644576] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.644726] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.644819] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.644879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.645049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.645142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.645235] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.147314] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.147608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.147638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.147976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.148125] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.148414] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.148573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.148673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.148942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.149010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.149140] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 1106.178835] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.178835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.178835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.178835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.178835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.187117] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 1106.216302] env[69656]: INFO networking_nsxv3.common.synchronization [None req-8f790304-a973-498b-a7bc-4cc5837998fd None None] Enqueued Resource ID: 683a023c-68e5-4835-8cf4-8aca41340f12 with Priority: HIGHEST for action port [ 1106.218021] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 683a023c-68e5-4835-8cf4-8aca41340f12 with Priority: HIGHEST for action port [ 1106.218021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-683a023c-68e5-4835-8cf4-8aca41340f12 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.218021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-683a023c-68e5-4835-8cf4-8aca41340f12" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.218466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-683a023c-68e5-4835-8cf4-8aca41340f12" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.218466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-683a023c-68e5-4835-8cf4-8aca41340f12" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.218466] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('683a023c-68e5-4835-8cf4-8aca41340f12',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.491084] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1106.491693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.723912] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 683a023c-68e5-4835-8cf4-8aca41340f12 [ 1106.724180] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.724312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.724398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.724833] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.725184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.725184] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:683a023c-68e5-4835-8cf4-8aca41340f12 already deleted. [ 1106.725254] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-683a023c-68e5-4835-8cf4-8aca41340f12" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.088770] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: SUCCESS [ 1107.091740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.201405] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 1108.201405] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b deletion is rescheduled due to dependency. [ 1108.201405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.209402] env[69656]: INFO networking_nsxv3.common.synchronization [req-5d7afd0e-e1ce-4367-9cc0-e9935884de1a req-4b941d5b-3327-44ad-b099-2f8006f6ac7a tempest-VolumesAdminNegativeTest-952299599 tempest-VolumesAdminNegativeTest-952299599-project-member] Enqueued Resource ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 with Priority: HIGHEST for action security_group_members [ 1108.209402] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 with Priority: HIGHEST for action security_group_members [ 1108.209402] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b4d26b-dd71-400b-9bfe-8da7699695a9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.209402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.209402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.209402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.209402] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.209402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.209402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.209402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.209402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.209402] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b4d26b-dd71-400b-9bfe-8da7699695a9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.680378] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.680566] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-123" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.682072] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-123" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.682072] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-123" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.682072] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.682072] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.682072] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.682072] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.682072] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.682352] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1108.682352] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1108.682414] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1108.682774] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1108.682774] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1108.682774] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1108.682907] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1108.706042] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1108.706042] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1108.706042] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1108.706042] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-123" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.706042] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-4409fc69-b7ff-47e1-935e-fbffe39e0db4 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.706042] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-4409fc69-b7ff-47e1-935e-fbffe39e0db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.706042] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-4409fc69-b7ff-47e1-935e-fbffe39e0db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.706042] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-4409fc69-b7ff-47e1-935e-fbffe39e0db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.706042] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4409fc69-b7ff-47e1-935e-fbffe39e0db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.713561] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.713673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.713724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.713926] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.714022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.715186] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.715346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.715407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.715577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.715652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.715740] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 already deleted. [ 1108.715817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.209320] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.209320] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.209320] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.209320] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.209320] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.209320] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 4409fc69-b7ff-47e1-935e-fbffe39e0db4 not found, creating... [ 1109.209320] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.209320] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.209790] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.209790] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.210247] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.210638] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.210996] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.211164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.211432] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.211647] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.211775] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 4409fc69-b7ff-47e1-935e-fbffe39e0db4 is going to be created. [ 1109.231315] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.233277] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.233277] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.233277] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.233277] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.233277] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-4409fc69-b7ff-47e1-935e-fbffe39e0db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.948520] env[69656]: INFO networking_nsxv3.common.synchronization [req-5d7afd0e-e1ce-4367-9cc0-e9935884de1a req-50c9ea11-7267-47aa-a1f8-dbeca500be79 service nova] Enqueued Resource ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 with Priority: HIGHEST for action security_group_rules [ 1109.949654] env[69656]: INFO networking_nsxv3.common.synchronization [req-5d7afd0e-e1ce-4367-9cc0-e9935884de1a req-50c9ea11-7267-47aa-a1f8-dbeca500be79 service nova] Enqueued Resource ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 with Priority: HIGHEST for action security_group_members [ 1109.949654] env[69656]: INFO networking_nsxv3.common.synchronization [req-5d7afd0e-e1ce-4367-9cc0-e9935884de1a req-50c9ea11-7267-47aa-a1f8-dbeca500be79 service nova] Enqueued Resource ID: 4409fc69-b7ff-47e1-935e-fbffe39e0db4 with Priority: HIGHEST for action port [ 1109.949654] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 with Priority: HIGHEST for action security_group_rules [ 1109.949654] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 with Priority: HIGHEST for action security_group_members [ 1109.949654] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4409fc69-b7ff-47e1-935e-fbffe39e0db4 with Priority: HIGHEST for action port [ 1109.950242] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48b4d26b-dd71-400b-9bfe-8da7699695a9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.950368] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.950439] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.950695] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.950811] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48b4d26b-dd71-400b-9bfe-8da7699695a9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.951674] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b4d26b-dd71-400b-9bfe-8da7699695a9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.951787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.951851] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.952037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.952184] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.952280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.952348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.952515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.952596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.952686] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b4d26b-dd71-400b-9bfe-8da7699695a9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.953869] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-4409fc69-b7ff-47e1-935e-fbffe39e0db4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.953869] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4409fc69-b7ff-47e1-935e-fbffe39e0db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.953869] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4409fc69-b7ff-47e1-935e-fbffe39e0db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.953869] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4409fc69-b7ff-47e1-935e-fbffe39e0db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.953869] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4409fc69-b7ff-47e1-935e-fbffe39e0db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.460656] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4409fc69-b7ff-47e1-935e-fbffe39e0db4 with status ACTIVE [ 1110.460656] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.460656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.460656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.461094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.461094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.461094] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.461187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.461266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.461521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.461597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.461796] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.461902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.461982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.462286] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.462379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.462421] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4409fc69-b7ff-47e1-935e-fbffe39e0db4 is going to be updated. [ 1110.463737] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b4d26b-dd71-400b-9bfe-8da7699695a9 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.463850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.464046] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48b4d26b-dd71-400b-9bfe-8da7699695a9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.482935] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.483201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.483201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.483374] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.483542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.483667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4409fc69-b7ff-47e1-935e-fbffe39e0db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.968744] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48b4d26b-dd71-400b-9bfe-8da7699695a9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.972232] env[69656]: INFO networking_nsxv3.common.synchronization [None req-ffc8772b-9ac1-4faa-a7d1-0854ecd0c0ad None None] Enqueued Resource ID: db39feff-82a9-4121-83a3-4f2f2ce8a72a with Priority: HIGHEST for action port [ 1110.974709] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db39feff-82a9-4121-83a3-4f2f2ce8a72a with Priority: HIGHEST for action port [ 1110.974709] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-db39feff-82a9-4121-83a3-4f2f2ce8a72a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.974709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db39feff-82a9-4121-83a3-4f2f2ce8a72a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.974709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db39feff-82a9-4121-83a3-4f2f2ce8a72a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.974709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db39feff-82a9-4121-83a3-4f2f2ce8a72a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.974709] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db39feff-82a9-4121-83a3-4f2f2ce8a72a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.474815] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.474815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.474815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.474815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.474815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.474815] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 is going to be created. [ 1111.485017] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db39feff-82a9-4121-83a3-4f2f2ce8a72a [ 1111.485017] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.485017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.485017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.485017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.485017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.485017] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db39feff-82a9-4121-83a3-4f2f2ce8a72a already deleted. [ 1111.485017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db39feff-82a9-4121-83a3-4f2f2ce8a72a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.494824] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.496888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.496888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.496888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.496888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.504041] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 in Status: UNINITIALIZED for 2s [ 1111.747057] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f2017646-3644-4d58-a5d9-bf26156129ab tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGHEST for action security_group_rules [ 1111.747439] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGHEST for action security_group_rules [ 1111.747596] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10987214-e215-44cd-98d2-5bd627e6c0e2 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.749015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.749015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.749015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.749229] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10987214-e215-44cd-98d2-5bd627e6c0e2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.850113] env[69656]: INFO networking_nsxv3.common.synchronization [None req-4cceae1e-e4dd-404a-88b5-9a0f15b00dc5 tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGHEST for action security_group_rules [ 1111.850113] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGHEST for action security_group_rules [ 1111.850113] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10987214-e215-44cd-98d2-5bd627e6c0e2 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.850113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.204935] env[69656]: INFO networking_nsxv3.common.synchronization [req-66c67bdc-4ea6-4f84-9e6d-232d8359619b req-4402c0cd-d5cf-4ef2-9fb2-d55ef7069fdc tempest-ServerRescueTestJSON-710259377 tempest-ServerRescueTestJSON-710259377-project-member] Enqueued Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_members [ 1112.206224] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_members [ 1112.206478] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.206624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.206668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.206867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.208095] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.208095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.208095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.208095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.208095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.208095] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.274676] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.274817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.274887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.275114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.275201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.275299] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 already deleted. [ 1112.276972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.276972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.276972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.276972] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10987214-e215-44cd-98d2-5bd627e6c0e2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.711455] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.800077] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.800408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.800525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.800833] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.800919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.801042] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 already deleted. [ 1112.801149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.200403] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-360 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.201445] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-360" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.201681] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-360" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.204309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-360" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.204309] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.204309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.204309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.204309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.204309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.204568] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1113.204597] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.208020] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.208020] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.208020] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1113.208020] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.208020] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.215741] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.223113] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1113.223298] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1113.223441] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1113.223628] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-360" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.224052] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-d308e305-99f1-41bd-bf8b-a8dfddd9d84b taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.224140] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-d308e305-99f1-41bd-bf8b-a8dfddd9d84b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.224235] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-d308e305-99f1-41bd-bf8b-a8dfddd9d84b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.224562] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-d308e305-99f1-41bd-bf8b-a8dfddd9d84b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.224825] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d308e305-99f1-41bd-bf8b-a8dfddd9d84b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.428093] env[69656]: INFO networking_nsxv3.common.synchronization [None req-041d1cba-a658-4cfd-9cc2-754581d8eeb1 tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGHEST for action security_group_rules [ 1113.428621] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGHEST for action security_group_rules [ 1113.428918] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-457b4cc0-32ad-4db2-819d-1a58cf1de954 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.429041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.429104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.429351] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.429437] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('457b4cc0-32ad-4db2-819d-1a58cf1de954',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.507713] env[69656]: INFO networking_nsxv3.common.synchronization [None req-b8f5e4be-0df4-4472-a689-6c428d41279a tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGHEST for action security_group_rules [ 1113.510128] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGHEST for action security_group_rules [ 1113.510128] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-457b4cc0-32ad-4db2-819d-1a58cf1de954 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.510128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.518585] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 in Status: SUCCESS [ 1113.518585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.518585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.518585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.518585] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.518585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.518585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.518585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.518585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.518585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.518585] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48b4d26b-dd71-400b-9bfe-8da7699695a9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.567739] env[69656]: INFO networking_nsxv3.common.synchronization [None req-8aa210c3-0c7b-4d43-8e28-0dadbefbffe4 None None] Enqueued Resource ID: 2138b06d-d026-4cb8-83fd-4fda8a9b0122 with Priority: HIGHEST for action port [ 1113.568249] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2138b06d-d026-4cb8-83fd-4fda8a9b0122 with Priority: HIGHEST for action port [ 1113.568548] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-2138b06d-d026-4cb8-83fd-4fda8a9b0122 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.568692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2138b06d-d026-4cb8-83fd-4fda8a9b0122" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.568751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2138b06d-d026-4cb8-83fd-4fda8a9b0122" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.569068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2138b06d-d026-4cb8-83fd-4fda8a9b0122" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.570457] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2138b06d-d026-4cb8-83fd-4fda8a9b0122',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.720407] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.720407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.720407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.720407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.720407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.720407] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 is going to be updated. [ 1113.730164] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.730164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.730164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.730164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.730164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.730164] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port d308e305-99f1-41bd-bf8b-a8dfddd9d84b not found, creating... [ 1113.730164] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.730164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.730164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.730164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.730164] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.730503] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.730503] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.730503] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.732126] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.733243] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.737059] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: d308e305-99f1-41bd-bf8b-a8dfddd9d84b is going to be created. [ 1113.748942] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.749134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.749180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.749350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.750860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.754276] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.754473] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.754603] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.754880] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.755118] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.755345] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-d308e305-99f1-41bd-bf8b-a8dfddd9d84b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.764385] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: IN_PROGRESS for 2s [ 1113.956568] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.956875] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.956875] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.957041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.957153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.957252] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 already deleted. [ 1113.957354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.957509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.957684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.957767] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('457b4cc0-32ad-4db2-819d-1a58cf1de954',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.020326] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b4d26b-dd71-400b-9bfe-8da7699695a9 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.022340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.022340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.022340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.023070] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.023239] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.023336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.025135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.025234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.025346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.025538] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b4d26b-dd71-400b-9bfe-8da7699695a9 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.025651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.025715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.025957] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.026118] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.026223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.026288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.026440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.026524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.026607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.026699] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48b4d26b-dd71-400b-9bfe-8da7699695a9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.073078] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2138b06d-d026-4cb8-83fd-4fda8a9b0122 [ 1114.073342] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.073489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.073581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.073771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.073858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.073979] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2138b06d-d026-4cb8-83fd-4fda8a9b0122 already deleted. [ 1114.074048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2138b06d-d026-4cb8-83fd-4fda8a9b0122" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.483695] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.483695] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.483695] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.483914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.483914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.484040] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 already deleted. [ 1114.484161] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.528838] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48b4d26b-dd71-400b-9bfe-8da7699695a9: rpc.has_security_group_logging(os_id): False [ 1114.546546] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.546546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.546546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.546771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.546925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.547091] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.547379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.547379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.547379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.547542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.547643] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.547722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.547769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.547918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.547977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.548461] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.548554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.548675] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.548884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.548974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.549200] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 is going to be created. [ 1114.601499] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.601499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.601499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.601499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.602145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.612537] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 in Status: IN_PROGRESS for 2s [ 1115.031431] env[69656]: INFO networking_nsxv3.common.synchronization [req-60cad12d-269d-4857-943b-6e482f87b36f req-bee5f31b-9eaa-45f3-b423-71bd491a991f tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 with Priority: HIGHEST for action security_group_members [ 1115.034615] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 with Priority: HIGHEST for action security_group_members [ 1115.035836] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0e73dee-afe4-4a44-9672-c68cc0af0557 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.036021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.036097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.036351] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.036516] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.036616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.036680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.036840] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.036932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.039332] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0e73dee-afe4-4a44-9672-c68cc0af0557',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.262873] env[69656]: INFO networking_nsxv3.common.synchronization [req-66c67bdc-4ea6-4f84-9e6d-232d8359619b req-957370e6-6bc2-4bfe-bf7d-4b6d0120d847 service nova] Enqueued Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_rules [ 1115.263088] env[69656]: INFO networking_nsxv3.common.synchronization [req-66c67bdc-4ea6-4f84-9e6d-232d8359619b req-957370e6-6bc2-4bfe-bf7d-4b6d0120d847 service nova] Enqueued Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_members [ 1115.263231] env[69656]: INFO networking_nsxv3.common.synchronization [req-66c67bdc-4ea6-4f84-9e6d-232d8359619b req-957370e6-6bc2-4bfe-bf7d-4b6d0120d847 service nova] Enqueued Resource ID: d308e305-99f1-41bd-bf8b-a8dfddd9d84b with Priority: HIGHEST for action port [ 1115.265625] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_rules [ 1115.265625] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_members [ 1115.265625] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d308e305-99f1-41bd-bf8b-a8dfddd9d84b with Priority: HIGHEST for action port [ 1115.265625] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.265625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.265625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.265625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.265625] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.265625] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.265625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.266011] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-d308e305-99f1-41bd-bf8b-a8dfddd9d84b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.266011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d308e305-99f1-41bd-bf8b-a8dfddd9d84b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.266011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d308e305-99f1-41bd-bf8b-a8dfddd9d84b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.266446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d308e305-99f1-41bd-bf8b-a8dfddd9d84b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.266481] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d308e305-99f1-41bd-bf8b-a8dfddd9d84b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.541860] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.542025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.542102] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.542739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.542739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.542739] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.542739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.542969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.542969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.543071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.543071] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 already deleted. [ 1115.543156] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.726827] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-565 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.726827] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.726827] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.726827] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.727593] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.727763] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.727905] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.728281] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.728443] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.728690] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.728819] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.728936] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.729062] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.729185] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.729298] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.729779] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.746303] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.746533] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1115.746699] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.746946] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.747224] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-b195b3e0-5b72-4f76-a35b-ef1071cf7616 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.747457] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-b195b3e0-5b72-4f76-a35b-ef1071cf7616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.747686] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-b195b3e0-5b72-4f76-a35b-ef1071cf7616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.748073] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-b195b3e0-5b72-4f76-a35b-ef1071cf7616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.748199] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b195b3e0-5b72-4f76-a35b-ef1071cf7616',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.768545] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.768545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.768545] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d308e305-99f1-41bd-bf8b-a8dfddd9d84b with status ACTIVE [ 1115.768780] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.768780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.768876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.769095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.769152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.769334] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.769417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.769466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.769615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.769974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.769974] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.769974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.770180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.770180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.770261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.770313] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d308e305-99f1-41bd-bf8b-a8dfddd9d84b is going to be updated. [ 1115.772870] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: SUCCESS [ 1115.773550] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.773550] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.773550] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.773733] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.773733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.773733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.773886] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.773939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.774045] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.787935] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.787935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.787935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.788154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.790189] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.790189] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d308e305-99f1-41bd-bf8b-a8dfddd9d84b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.250747] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.251051] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.251148] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.251407] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.251585] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.251749] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port b195b3e0-5b72-4f76-a35b-ef1071cf7616 not found, creating... [ 1116.252039] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.252207] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.254051] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.254051] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.254051] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.254051] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.254051] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.254051] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.254051] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.254051] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.254051] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: b195b3e0-5b72-4f76-a35b-ef1071cf7616 is going to be created. [ 1116.278766] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.281498] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.282169] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.282169] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.282758] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.282758] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.282758] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-b195b3e0-5b72-4f76-a35b-ef1071cf7616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.624084] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 in Status: SUCCESS [ 1116.624335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.781485] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.272688] env[69656]: INFO networking_nsxv3.common.synchronization [req-60cad12d-269d-4857-943b-6e482f87b36f req-324f2edd-ec0d-4828-93d4-c26f842a5644 service nova] Enqueued Resource ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 with Priority: HIGHEST for action security_group_rules [ 1117.273055] env[69656]: INFO networking_nsxv3.common.synchronization [req-60cad12d-269d-4857-943b-6e482f87b36f req-324f2edd-ec0d-4828-93d4-c26f842a5644 service nova] Enqueued Resource ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 with Priority: HIGHEST for action security_group_members [ 1117.273228] env[69656]: INFO networking_nsxv3.common.synchronization [req-60cad12d-269d-4857-943b-6e482f87b36f req-324f2edd-ec0d-4828-93d4-c26f842a5644 service nova] Enqueued Resource ID: b195b3e0-5b72-4f76-a35b-ef1071cf7616 with Priority: HIGHEST for action port [ 1117.273855] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 with Priority: HIGHEST for action security_group_rules [ 1117.274041] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 with Priority: HIGHEST for action security_group_members [ 1117.276035] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b195b3e0-5b72-4f76-a35b-ef1071cf7616 with Priority: HIGHEST for action port [ 1117.276379] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0e73dee-afe4-4a44-9672-c68cc0af0557 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.276547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.276619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.276901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.276994] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0e73dee-afe4-4a44-9672-c68cc0af0557',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.277958] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0e73dee-afe4-4a44-9672-c68cc0af0557 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.278109] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.278209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.278423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.278598] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.278729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.278802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.278988] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.279080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.279207] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0e73dee-afe4-4a44-9672-c68cc0af0557',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.280251] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-b195b3e0-5b72-4f76-a35b-ef1071cf7616 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.280418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b195b3e0-5b72-4f76-a35b-ef1071cf7616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.280474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b195b3e0-5b72-4f76-a35b-ef1071cf7616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.280705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b195b3e0-5b72-4f76-a35b-ef1071cf7616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.280826] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b195b3e0-5b72-4f76-a35b-ef1071cf7616',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.282670] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.282810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.282874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.283012] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.283101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.283213] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 is going to be updated. [ 1117.308901] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.309587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.310353] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.310353] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.310626] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.320117] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: IN_PROGRESS for 2s [ 1117.783971] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0e73dee-afe4-4a44-9672-c68cc0af0557',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.785235] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0e73dee-afe4-4a44-9672-c68cc0af0557 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.785362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.785682] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b195b3e0-5b72-4f76-a35b-ef1071cf7616 with status ACTIVE [ 1117.785848] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.786013] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.786013] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.786219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.786303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.786466] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.786909] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.786909] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.786909] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.786909] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.787119] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.787119] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.787186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.787295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.787423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.787702] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b195b3e0-5b72-4f76-a35b-ef1071cf7616 is going to be updated. [ 1117.808318] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.808501] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.808567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.808754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.808898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.809079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b195b3e0-5b72-4f76-a35b-ef1071cf7616" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.286363] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0e73dee-afe4-4a44-9672-c68cc0af0557',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.788342] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.788504] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.788578] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.788974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.789086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.789187] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 is going to be created. [ 1118.812502] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.812754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.812831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.813066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.813505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.823945] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 in Status: UNINITIALIZED for 2s [ 1119.329704] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: SUCCESS [ 1119.330065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.330065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.330279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.330509] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.330623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.330691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.330854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.330939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.331041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.331132] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.835105] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.835267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.835338] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.835561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.835811] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.835918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.835918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.836424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.836424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.836424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.836424] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.836611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.836611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.836730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.836780] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.836860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.836907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.837019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.837097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.837178] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.837457] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.210382] env[69656]: INFO networking_nsxv3.common.synchronization [req-fb44e4ab-1177-4a89-89ed-fd1b97a265f8 req-965dbc61-52bc-4b7e-9499-f385e94c8089 tempest-ServerDiskConfigTestJSON-2110996415 tempest-ServerDiskConfigTestJSON-2110996415-project-member] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1120.210992] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1120.211726] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.212417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.212417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.212417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.212654] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.212654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.212654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.212841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.212952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.213067] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.340246] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb962a91-1fd6-476a-900f-fb50bdf4b147: rpc.has_security_group_logging(os_id): False [ 1120.357677] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.357677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.357830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.357924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.358019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.358309] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.358309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.358497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.358531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.359378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.359378] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.359378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.359378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.359378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.359378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.359378] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.359652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.359652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.359652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.359652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.359775] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 is going to be updated. [ 1120.414168] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.414168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.414318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.414410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.414554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.430375] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: IN_PROGRESS for 2s [ 1120.645490] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-940 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.645700] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.645828] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.646121] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.646375] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.646535] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.646677] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.646910] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.647174] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.648127] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.648127] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.648127] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.648127] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.648127] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.648127] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.648127] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.667861] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.669023] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1120.669023] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.669023] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.669023] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-21191ba5-a6a6-496f-b896-4796c9160074 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.669023] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-21191ba5-a6a6-496f-b896-4796c9160074" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.669023] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-21191ba5-a6a6-496f-b896-4796c9160074" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.669503] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-21191ba5-a6a6-496f-b896-4796c9160074" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.669503] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21191ba5-a6a6-496f-b896-4796c9160074',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.715382] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.715557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.715615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.715828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.715921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.716132] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.716254] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.716328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.717009] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.717143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.717243] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 1120.741957] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.742130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.742207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.742415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.742598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.750396] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 1120.835369] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 in Status: SUCCESS [ 1120.835564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.835781] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.836009] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.836228] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.836358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.836426] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.836585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.836665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.836751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.836859] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0e73dee-afe4-4a44-9672-c68cc0af0557',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.174657] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.174984] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.175215] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.175724] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.175940] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.176185] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 21191ba5-a6a6-496f-b896-4796c9160074 not found, creating... [ 1121.176580] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.176806] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.176985] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.177319] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.177517] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.177935] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.178183] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.178362] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.178691] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.178930] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.179171] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 21191ba5-a6a6-496f-b896-4796c9160074 is going to be created. [ 1121.208463] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.208712] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.208881] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.209199] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.209457] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.209702] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-21191ba5-a6a6-496f-b896-4796c9160074" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.343416] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0e73dee-afe4-4a44-9672-c68cc0af0557',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.845697] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0e73dee-afe4-4a44-9672-c68cc0af0557: rpc.has_security_group_logging(os_id): False [ 1121.861989] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.862313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.862446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.862728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.862876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.863187] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.863348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.863463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.863663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.863788] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.865139] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 is going to be created. [ 1121.919686] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.919887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.919969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.920219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.920399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.931128] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 in Status: IN_PROGRESS for 2s [ 1122.044990] env[69656]: INFO networking_nsxv3.common.synchronization [req-fb44e4ab-1177-4a89-89ed-fd1b97a265f8 req-a4bb97db-6aa0-44ce-93e8-fdb02edd7e61 service nova] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_rules [ 1122.045186] env[69656]: INFO networking_nsxv3.common.synchronization [req-fb44e4ab-1177-4a89-89ed-fd1b97a265f8 req-a4bb97db-6aa0-44ce-93e8-fdb02edd7e61 service nova] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1122.045327] env[69656]: INFO networking_nsxv3.common.synchronization [req-fb44e4ab-1177-4a89-89ed-fd1b97a265f8 req-a4bb97db-6aa0-44ce-93e8-fdb02edd7e61 service nova] Enqueued Resource ID: 21191ba5-a6a6-496f-b896-4796c9160074 with Priority: HIGHEST for action port [ 1122.049734] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_rules [ 1122.049950] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1122.050076] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21191ba5-a6a6-496f-b896-4796c9160074 with Priority: HIGHEST for action port [ 1122.050652] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.050786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.050878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.051082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.051160] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.051994] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.052089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.052281] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-21191ba5-a6a6-496f-b896-4796c9160074 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.052389] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21191ba5-a6a6-496f-b896-4796c9160074" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.052451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21191ba5-a6a6-496f-b896-4796c9160074" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.052658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21191ba5-a6a6-496f-b896-4796c9160074" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.052733] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21191ba5-a6a6-496f-b896-4796c9160074',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.445591] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: SUCCESS [ 1122.446039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.549275] env[69656]: INFO networking_nsxv3.common.synchronization [req-00e58d2d-d349-4ef7-bc0c-8b9c431fa54a req-bab12fc3-7c51-4099-b724-59e8fb9573d3 tempest-VolumesAdminNegativeTest-952299599 tempest-VolumesAdminNegativeTest-952299599-project-member] Enqueued Resource ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 with Priority: HIGHEST for action security_group_members [ 1122.549877] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 with Priority: HIGHEST for action security_group_members [ 1122.550693] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-48b4d26b-dd71-400b-9bfe-8da7699695a9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.550800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.550854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.551134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.551519] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.551680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.551751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.551935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.552054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.552179] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48b4d26b-dd71-400b-9bfe-8da7699695a9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.556310] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.556310] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.556310] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21191ba5-a6a6-496f-b896-4796c9160074 with status ACTIVE [ 1122.556718] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.556718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.556718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.556944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.556990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.557420] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.557570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.557649] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.557821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.557983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.558144] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.558257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.558524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.558695] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.558911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.559621] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21191ba5-a6a6-496f-b896-4796c9160074 is going to be updated. [ 1122.579434] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.579434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.579434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.579699] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.579739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.579943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21191ba5-a6a6-496f-b896-4796c9160074" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.771113] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 1122.771351] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b deletion is rescheduled due to dependency. [ 1122.771492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.771696] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.771923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.772121] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.772904] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.772904] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.772904] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.772904] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.772904] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.054528] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.054688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.054758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.054981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.055095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.055295] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.055394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.055454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.055607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.055685] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.055817] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 is going to be updated. [ 1123.082051] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.082051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.082259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.082291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.082424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.089780] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 in Status: IN_PROGRESS for 2s [ 1123.275278] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.778135] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.943376] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 in Status: SUCCESS [ 1123.943689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.281397] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.281560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.281631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.281853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.281946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.282092] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 1124.309504] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.309504] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.309719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.309774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.309919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.318135] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 1125.101387] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 in Status: SUCCESS [ 1125.101656] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 deletion is rescheduled due to dependency. [ 1125.101689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.327599] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 1126.327896] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.328009] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.328237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.328431] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.328549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.328617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.328774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.328857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.328982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.329052] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.832566] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.832566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.832566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.832566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.832882] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.832937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.832993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.833285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.833399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.834054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.834054] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.834054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.834054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.834054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.834437] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.834437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.834437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.834561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.834663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.834768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.834977] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.167683] env[69656]: INFO networking_nsxv3.common.synchronization [req-7de01b6b-ccc5-485e-97b6-9b59bb9d4ea4 req-80c44b29-8dbd-41ab-a8f5-1918f46720e5 tempest-ServerTagsTestJSON-224867736 tempest-ServerTagsTestJSON-224867736-project-member] Enqueued Resource ID: 012722d0-145e-4c53-8203-3606845f8f43 with Priority: HIGHEST for action security_group_members [ 1127.168240] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012722d0-145e-4c53-8203-3606845f8f43 with Priority: HIGHEST for action security_group_members [ 1127.168541] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-012722d0-145e-4c53-8203-3606845f8f43 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.168666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.168736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.168994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.169650] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.169801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.169892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.170104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.170238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.170358] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('012722d0-145e-4c53-8203-3606845f8f43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.338375] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ceadc5a6-0e5a-4475-96ab-3f4a1cec315b: rpc.has_security_group_logging(os_id): False [ 1127.359366] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.359366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.359366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.359366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.359366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.359366] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.359366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.359366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.359366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.359366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.359366] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.359366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.359366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.359366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.359366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.360389] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.360695] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.364133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.364133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.364133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.364133] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 1127.435412] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.435958] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.436467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.436467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.437396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.450368] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 1127.571290] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-440 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.571533] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-440" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.571703] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-440" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.572260] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-440" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.572636] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.573130] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.573275] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.573536] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.573734] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.573991] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.574392] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.574563] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.574688] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.574837] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.574957] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.575928] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.597197] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.597438] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.597589] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.597779] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-440" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.598177] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-c2b59a0d-c0f0-4b63-be2a-5c2035e67800 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.598390] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-c2b59a0d-c0f0-4b63-be2a-5c2035e67800" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.598520] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-c2b59a0d-c0f0-4b63-be2a-5c2035e67800" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.598865] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-c2b59a0d-c0f0-4b63-be2a-5c2035e67800" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.599044] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2b59a0d-c0f0-4b63-be2a-5c2035e67800',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.673029] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.673753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.673753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.673753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.673753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.673929] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.673929] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.674066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.674186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.674231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.674320] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012722d0-145e-4c53-8203-3606845f8f43 already deleted. [ 1127.674401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.102058] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.102277] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.102376] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.102841] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.103064] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.103322] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port c2b59a0d-c0f0-4b63-be2a-5c2035e67800 not found, creating... [ 1128.103728] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.103954] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.104167] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.104482] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.104790] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.105152] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.105403] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.105601] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.105871] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.106126] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.106325] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: c2b59a0d-c0f0-4b63-be2a-5c2035e67800 is going to be created. [ 1128.124409] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.124622] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.124762] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.125121] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.125345] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.125577] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-c2b59a0d-c0f0-4b63-be2a-5c2035e67800" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.291217] env[69656]: INFO networking_nsxv3.common.synchronization [req-7de01b6b-ccc5-485e-97b6-9b59bb9d4ea4 req-1beaa279-4df3-4c2d-a547-9bb0823473c8 service nova] Enqueued Resource ID: 012722d0-145e-4c53-8203-3606845f8f43 with Priority: HIGHEST for action security_group_rules [ 1129.291584] env[69656]: INFO networking_nsxv3.common.synchronization [req-7de01b6b-ccc5-485e-97b6-9b59bb9d4ea4 req-1beaa279-4df3-4c2d-a547-9bb0823473c8 service nova] Enqueued Resource ID: 012722d0-145e-4c53-8203-3606845f8f43 with Priority: HIGHEST for action security_group_members [ 1129.291902] env[69656]: INFO networking_nsxv3.common.synchronization [req-7de01b6b-ccc5-485e-97b6-9b59bb9d4ea4 req-1beaa279-4df3-4c2d-a547-9bb0823473c8 service nova] Enqueued Resource ID: c2b59a0d-c0f0-4b63-be2a-5c2035e67800 with Priority: HIGHEST for action port [ 1129.292683] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012722d0-145e-4c53-8203-3606845f8f43 with Priority: HIGHEST for action security_group_rules [ 1129.292867] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012722d0-145e-4c53-8203-3606845f8f43 with Priority: HIGHEST for action security_group_members [ 1129.292994] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2b59a0d-c0f0-4b63-be2a-5c2035e67800 with Priority: HIGHEST for action port [ 1129.293392] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-012722d0-145e-4c53-8203-3606845f8f43 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.293543] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.293620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.293960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.294097] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('012722d0-145e-4c53-8203-3606845f8f43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.295262] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-012722d0-145e-4c53-8203-3606845f8f43 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.295392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.295461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.295733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.295923] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.296024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.296096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.296251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.296359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.296452] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('012722d0-145e-4c53-8203-3606845f8f43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.297306] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2b59a0d-c0f0-4b63-be2a-5c2035e67800 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.297424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2b59a0d-c0f0-4b63-be2a-5c2035e67800" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.297489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2b59a0d-c0f0-4b63-be2a-5c2035e67800" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.297758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2b59a0d-c0f0-4b63-be2a-5c2035e67800" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.297758] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2b59a0d-c0f0-4b63-be2a-5c2035e67800',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.465095] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 1129.465335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.632781] env[69656]: INFO networking_nsxv3.common.synchronization [req-cfadf37d-1f1c-4a37-a7dd-d1706a57fa7e req-35a8ea65-150a-41f9-b7e4-ace22a30cbbd tempest-DeleteServersTestJSON-708906239 tempest-DeleteServersTestJSON-708906239-project-member] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1129.633986] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1129.634397] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.634527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.634597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.634798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.634947] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.635054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.635117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.635303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.635422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.635547] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.799817] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-012722d0-145e-4c53-8203-3606845f8f43 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.800041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.800276] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('012722d0-145e-4c53-8203-3606845f8f43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.804252] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2b59a0d-c0f0-4b63-be2a-5c2035e67800 with status ACTIVE [ 1129.804509] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.804860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.804860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.805112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.805293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.805709] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.805852] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.805940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.806186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.806271] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.806528] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.806670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.806767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.806957] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.807078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.807195] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2b59a0d-c0f0-4b63-be2a-5c2035e67800 is going to be updated. [ 1129.826172] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.826363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.826453] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.826777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.826887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.827117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2b59a0d-c0f0-4b63-be2a-5c2035e67800" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.137892] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.138152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.138245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.138457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.142206] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.142402] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.142529] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.142883] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.143147] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.143307] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.143588] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.143653] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.143791] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.143999] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.144453] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.144585] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.144704] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.144882] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.145193] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.145377] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.157781] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.158034] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.158153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.158221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.158494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.158494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.158572] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1130.162769] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.162946] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1130.163113] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.163364] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.163579] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-d9aa70e5-4de5-4ae0-8cf8-013921c49e1e taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.163751] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-d9aa70e5-4de5-4ae0-8cf8-013921c49e1e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.163955] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-d9aa70e5-4de5-4ae0-8cf8-013921c49e1e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.164287] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-d9aa70e5-4de5-4ae0-8cf8-013921c49e1e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.164430] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9aa70e5-4de5-4ae0-8cf8-013921c49e1e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.179717] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.179881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.179925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.180154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.181815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.190944] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1130.303257] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('012722d0-145e-4c53-8203-3606845f8f43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.667839] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.667839] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.668062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.668323] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.668511] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.668760] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port d9aa70e5-4de5-4ae0-8cf8-013921c49e1e not found, creating... [ 1130.668991] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.669170] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.669292] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.669528] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.669671] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.669954] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.670131] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.670253] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.670459] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.670595] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.670763] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: d9aa70e5-4de5-4ae0-8cf8-013921c49e1e is going to be created. [ 1130.690374] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.690720] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.691039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.691159] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.691388] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.691613] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-d9aa70e5-4de5-4ae0-8cf8-013921c49e1e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.806590] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.806754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.806754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.807020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.807020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.807173] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012722d0-145e-4c53-8203-3606845f8f43 is going to be created. [ 1130.835025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.835025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.835025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.835025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.835025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.842660] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012722d0-145e-4c53-8203-3606845f8f43 in Status: UNINITIALIZED for 2s [ 1132.033349] env[69656]: INFO networking_nsxv3.common.synchronization [req-cfadf37d-1f1c-4a37-a7dd-d1706a57fa7e req-dc95cd58-7620-4c77-88a1-62a1bf9cda7b service nova] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_rules [ 1132.033748] env[69656]: INFO networking_nsxv3.common.synchronization [req-cfadf37d-1f1c-4a37-a7dd-d1706a57fa7e req-dc95cd58-7620-4c77-88a1-62a1bf9cda7b service nova] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1132.033890] env[69656]: INFO networking_nsxv3.common.synchronization [req-cfadf37d-1f1c-4a37-a7dd-d1706a57fa7e req-dc95cd58-7620-4c77-88a1-62a1bf9cda7b service nova] Enqueued Resource ID: d9aa70e5-4de5-4ae0-8cf8-013921c49e1e with Priority: HIGHEST for action port [ 1132.034429] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_rules [ 1132.034613] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1132.034763] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9aa70e5-4de5-4ae0-8cf8-013921c49e1e with Priority: HIGHEST for action port [ 1132.035039] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.035173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.035264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.035522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.035626] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.037779] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.037779] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.038093] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9aa70e5-4de5-4ae0-8cf8-013921c49e1e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.038241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9aa70e5-4de5-4ae0-8cf8-013921c49e1e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.038333] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9aa70e5-4de5-4ae0-8cf8-013921c49e1e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.038607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9aa70e5-4de5-4ae0-8cf8-013921c49e1e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.038727] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9aa70e5-4de5-4ae0-8cf8-013921c49e1e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.205369] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1132.205728] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 deletion is rescheduled due to dependency. [ 1132.206978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.207636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.208008] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.208309] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.208564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.208896] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.209231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.209423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.209603] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.539214] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.539214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.541599] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9aa70e5-4de5-4ae0-8cf8-013921c49e1e with status ACTIVE [ 1132.541722] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.541856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.541929] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.542155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.542245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.542427] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.542521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.542580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.542780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.542859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.543103] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.543169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.543236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.543361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.543435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.543518] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9aa70e5-4de5-4ae0-8cf8-013921c49e1e is going to be updated. [ 1132.563700] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.563894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.563957] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.564192] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.564334] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.564509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9aa70e5-4de5-4ae0-8cf8-013921c49e1e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.712533] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.851387] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012722d0-145e-4c53-8203-3606845f8f43 in Status: SUCCESS [ 1132.851598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.851753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.851994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.852195] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.852311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.852375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.852530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.852610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.852871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.852986] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('012722d0-145e-4c53-8203-3606845f8f43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.214524] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.233160] env[69656]: INFO networking_nsxv3.common.synchronization [req-4d027c83-9710-46e8-a8bd-af110fca5ae1 req-74498964-9f5a-487f-a7ca-6c4773e563b5 tempest-ServersAdminNegativeTestJSON-2005902791 tempest-ServersAdminNegativeTestJSON-2005902791-project-member] Enqueued Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_members [ 1133.233160] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_members [ 1133.233160] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.233160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.233160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.233160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.233606] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.233827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.233971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.234217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.234437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.234636] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.357472] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-012722d0-145e-4c53-8203-3606845f8f43 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.357472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.357472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.357472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.357472] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.357472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.357472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.357472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.357472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.357472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.357472] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-012722d0-145e-4c53-8203-3606845f8f43 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.357472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.357472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.357472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.357472] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.357472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.358144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.358144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.358144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.358144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.358144] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('012722d0-145e-4c53-8203-3606845f8f43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.649209] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.649411] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.649541] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.649817] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.650253] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.650449] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.650631] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.650892] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.651057] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.651318] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1133.651441] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.651558] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.651672] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.651792] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1133.651902] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.652059] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.670467] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.670467] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1133.670467] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.670467] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-712" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.670467] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-b6935e94-5fe4-46bc-bb79-7f3f447bc435 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.670467] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-b6935e94-5fe4-46bc-bb79-7f3f447bc435" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.670467] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-b6935e94-5fe4-46bc-bb79-7f3f447bc435" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.670987] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-b6935e94-5fe4-46bc-bb79-7f3f447bc435" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.670987] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6935e94-5fe4-46bc-bb79-7f3f447bc435',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.717650] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.717938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.718084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.718411] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.718516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.718646] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1133.738103] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.753023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.753023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.753023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.753023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.753023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.764581] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1133.862142] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 012722d0-145e-4c53-8203-3606845f8f43: rpc.has_security_group_logging(os_id): False [ 1133.879204] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.879204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.879204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.879204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.879204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.879204] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.879204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.879204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.879607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.879607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.879607] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.879712] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.879712] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.879827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.880151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.880151] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.880279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.880279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.881710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.881710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.881710] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 012722d0-145e-4c53-8203-3606845f8f43 is going to be created. [ 1133.936341] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.936594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.936594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.936732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.937125] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.948801] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 012722d0-145e-4c53-8203-3606845f8f43 in Status: IN_PROGRESS for 2s [ 1134.173594] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.173914] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.174064] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.174372] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.174530] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.174692] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port b6935e94-5fe4-46bc-bb79-7f3f447bc435 not found, creating... [ 1134.175086] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.175259] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.175378] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.175601] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.175742] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.176044] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.176213] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.176332] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.176534] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.176675] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.176816] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: b6935e94-5fe4-46bc-bb79-7f3f447bc435 is going to be created. [ 1134.212127] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.212360] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.212488] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.212849] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.213103] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.213334] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-b6935e94-5fe4-46bc-bb79-7f3f447bc435" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.241922] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.744197] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.744379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.744443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.744666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.744789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.744941] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d70c367d-ca7b-45b3-9579-5b05739f400a is going to be updated. [ 1134.774976] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.775144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.775232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.775437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.775580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.784999] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: IN_PROGRESS for 2s [ 1135.213995] env[69656]: INFO networking_nsxv3.common.synchronization [req-4d027c83-9710-46e8-a8bd-af110fca5ae1 req-25c13db6-d82c-484d-bf95-bd23648300c2 service nova] Enqueued Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_rules [ 1135.214190] env[69656]: INFO networking_nsxv3.common.synchronization [req-4d027c83-9710-46e8-a8bd-af110fca5ae1 req-25c13db6-d82c-484d-bf95-bd23648300c2 service nova] Enqueued Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_members [ 1135.214339] env[69656]: INFO networking_nsxv3.common.synchronization [req-4d027c83-9710-46e8-a8bd-af110fca5ae1 req-25c13db6-d82c-484d-bf95-bd23648300c2 service nova] Enqueued Resource ID: b6935e94-5fe4-46bc-bb79-7f3f447bc435 with Priority: HIGHEST for action port [ 1135.214561] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_rules [ 1135.214689] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_members [ 1135.214787] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6935e94-5fe4-46bc-bb79-7f3f447bc435 with Priority: HIGHEST for action port [ 1135.215338] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.215452] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.215521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.215770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.215853] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.217367] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.217470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.217648] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6935e94-5fe4-46bc-bb79-7f3f447bc435 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.217746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6935e94-5fe4-46bc-bb79-7f3f447bc435" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.217812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6935e94-5fe4-46bc-bb79-7f3f447bc435" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.217979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6935e94-5fe4-46bc-bb79-7f3f447bc435" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.218063] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6935e94-5fe4-46bc-bb79-7f3f447bc435',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.719490] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.719901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.719901] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6935e94-5fe4-46bc-bb79-7f3f447bc435 with status ACTIVE [ 1135.720161] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.720342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.720452] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.720750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.720848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.721152] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.721290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.721388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.721618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.721737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.722013] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.722158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.722337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.722446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.722552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.722690] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6935e94-5fe4-46bc-bb79-7f3f447bc435 is going to be updated. [ 1135.742728] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.742919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.743097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.743363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.743590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.743797] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6935e94-5fe4-46bc-bb79-7f3f447bc435" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.771697] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1135.771960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.772182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.772404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.772599] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.772733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.772813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.772956] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.773042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.773133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.773226] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.798398] env[69656]: INFO networking_nsxv3.common.synchronization [req-492712b4-dc54-4f78-a353-2136eab8589e req-f8d56e27-f303-448c-942c-b2329f15496d tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGHEST for action security_group_members [ 1135.798931] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGHEST for action security_group_members [ 1135.799594] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-10987214-e215-44cd-98d2-5bd627e6c0e2 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.799594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.799594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.799784] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.799935] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.800221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.800327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.800513] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.800642] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.800764] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10987214-e215-44cd-98d2-5bd627e6c0e2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.960368] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 012722d0-145e-4c53-8203-3606845f8f43 in Status: SUCCESS [ 1135.962910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.275393] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.275393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.275393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.275575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.275777] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.275909] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.275985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.276230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.276273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.276402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.276590] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.276717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.276778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.276920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.277070] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.277158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.277216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.277349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.277420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.277498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.277582] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.303945] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.304160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.304248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.304519] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.304614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.304855] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.304977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.305050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.305228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.305358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.305467] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 already deleted. [ 1136.305574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.396758] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.398186] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.398186] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.398186] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.398705] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.398923] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.399062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.399300] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.399448] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.399655] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.399771] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.399887] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.399998] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.400122] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.402603] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.402603] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.420877] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.421089] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1136.421238] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.421422] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.421738] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-88912779-e048-4054-a696-a01f06ffd4c9 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.422024] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-88912779-e048-4054-a696-a01f06ffd4c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.422279] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-88912779-e048-4054-a696-a01f06ffd4c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.422489] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-88912779-e048-4054-a696-a01f06ffd4c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.422630] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88912779-e048-4054-a696-a01f06ffd4c9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.782601] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3274dea2-eaf7-4169-ba91-1154eac58032: rpc.has_security_group_logging(os_id): False [ 1136.793709] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: SUCCESS [ 1136.793972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.794150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.794356] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.794616] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.794738] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.794805] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.794964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.795076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.795176] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.797827] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.797940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.798057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.798182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.798262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.798456] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.798553] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.798614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.798755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.798913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.799118] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.799215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.799275] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.799513] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.799596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.799935] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.800062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.800134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.800288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.800369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.800456] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1136.855617] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.855843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.855843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.856022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.856180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.866189] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1136.927715] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.928043] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.928200] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.928495] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.928650] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.928818] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 88912779-e048-4054-a696-a01f06ffd4c9 not found, creating... [ 1136.929203] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.929300] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.929422] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.929680] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.929864] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.930170] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.930335] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.930458] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.930674] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.930811] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.930958] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 88912779-e048-4054-a696-a01f06ffd4c9 is going to be created. [ 1136.961750] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.962056] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.962194] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.962470] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.962772] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.963188] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-88912779-e048-4054-a696-a01f06ffd4c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.297868] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.800918] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.179912] env[69656]: INFO networking_nsxv3.common.synchronization [req-492712b4-dc54-4f78-a353-2136eab8589e req-908cf3a7-7584-4f7c-b20d-83c1e394dbd9 service nova] Enqueued Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGHEST for action security_group_rules [ 1138.180157] env[69656]: INFO networking_nsxv3.common.synchronization [req-492712b4-dc54-4f78-a353-2136eab8589e req-908cf3a7-7584-4f7c-b20d-83c1e394dbd9 service nova] Enqueued Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGHEST for action security_group_members [ 1138.180306] env[69656]: INFO networking_nsxv3.common.synchronization [req-492712b4-dc54-4f78-a353-2136eab8589e req-908cf3a7-7584-4f7c-b20d-83c1e394dbd9 service nova] Enqueued Resource ID: 88912779-e048-4054-a696-a01f06ffd4c9 with Priority: HIGHEST for action port [ 1138.180899] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGHEST for action security_group_rules [ 1138.184973] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGHEST for action security_group_members [ 1138.184973] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88912779-e048-4054-a696-a01f06ffd4c9 with Priority: HIGHEST for action port [ 1138.184973] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10987214-e215-44cd-98d2-5bd627e6c0e2 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.184973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.184973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.184973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.184973] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10987214-e215-44cd-98d2-5bd627e6c0e2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.184973] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-10987214-e215-44cd-98d2-5bd627e6c0e2 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.184973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.184973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.184973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.184973] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.184973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.184973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.184973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.184973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.184973] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10987214-e215-44cd-98d2-5bd627e6c0e2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.186896] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-88912779-e048-4054-a696-a01f06ffd4c9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.187048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88912779-e048-4054-a696-a01f06ffd4c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.187091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88912779-e048-4054-a696-a01f06ffd4c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.187250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88912779-e048-4054-a696-a01f06ffd4c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.187327] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88912779-e048-4054-a696-a01f06ffd4c9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.306721] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.306879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.306938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.307188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.307267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.307375] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d70c367d-ca7b-45b3-9579-5b05739f400a is going to be updated. [ 1138.337442] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.337577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.337657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.337935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.338705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.347214] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: IN_PROGRESS for 2s [ 1138.430224] env[69656]: INFO networking_nsxv3.common.synchronization [req-f64de20e-526f-4b6d-a8b9-da3d86aa3156 req-d835497d-8399-4394-a3d7-4df1ce13e016 tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGHEST for action security_group_members [ 1138.430937] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGHEST for action security_group_members [ 1138.433982] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-457b4cc0-32ad-4db2-819d-1a58cf1de954 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.433982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.433982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.434280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.434448] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.434544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.434598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.434748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.434832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.434928] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('457b4cc0-32ad-4db2-819d-1a58cf1de954',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.688902] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10987214-e215-44cd-98d2-5bd627e6c0e2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.692363] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-10987214-e215-44cd-98d2-5bd627e6c0e2 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.692363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.692363] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88912779-e048-4054-a696-a01f06ffd4c9 with status ACTIVE [ 1138.692363] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.692363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.692363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.692363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.692363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.692363] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.692363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.692363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.692363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.692363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.692363] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.693148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.693148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.693148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.693148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.693148] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88912779-e048-4054-a696-a01f06ffd4c9 is going to be updated. [ 1138.714248] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.714248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.714248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.714248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.714248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.714248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88912779-e048-4054-a696-a01f06ffd4c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.881533] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1138.881810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.938572] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.942014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.942014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.942014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.942014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.942014] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.942014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.942014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.942014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.942014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.942014] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 already deleted. [ 1138.942014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.985338] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-855 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.985338] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-855" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.985532] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-855" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.985773] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-855" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.985998] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.986173] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.986292] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.986508] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.986652] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.986865] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.986980] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.987133] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.987249] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.987366] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.987476] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.987612] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.006021] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.006229] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1139.006372] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.006548] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-855" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.006876] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-285745bc-c421-49e0-86a6-50eb90a0c252 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.007046] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-285745bc-c421-49e0-86a6-50eb90a0c252" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.007171] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-285745bc-c421-49e0-86a6-50eb90a0c252" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.007520] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-285745bc-c421-49e0-86a6-50eb90a0c252" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.007672] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('285745bc-c421-49e0-86a6-50eb90a0c252',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.191058] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10987214-e215-44cd-98d2-5bd627e6c0e2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.511680] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.512180] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.515019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.515019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.515019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.515019] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 285745bc-c421-49e0-86a6-50eb90a0c252 not found, creating... [ 1139.515019] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.515019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.515019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.515019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.515019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.515019] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.515521] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.515710] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.516114] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.516438] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.516753] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 285745bc-c421-49e0-86a6-50eb90a0c252 is going to be created. [ 1139.553234] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.553234] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.553234] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.553234] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.553234] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.553234] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-285745bc-c421-49e0-86a6-50eb90a0c252" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.693637] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.694977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.694977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.694977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.694977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.694977] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 is going to be created. [ 1139.721663] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.721663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.721663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.721663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.721663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.731751] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 in Status: UNINITIALIZED for 2s [ 1139.791814] env[69656]: INFO networking_nsxv3.common.synchronization [req-65350f39-429d-4404-bb65-0e61c464b37e req-ed4e323a-2aee-4546-a65b-f2a7d3ed9caf tempest-ServerRescueTestJSON-710259377 tempest-ServerRescueTestJSON-710259377-project-member] Enqueued Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_members [ 1139.792401] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_members [ 1139.792712] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.792901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.792963] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.793180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.793338] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.793433] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.793494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.793632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.793721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.793840] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.300436] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.357439] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: SUCCESS [ 1140.357825] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.358116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.358451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.359359] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.359490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.359558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.359760] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.359843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.359952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.360064] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.802634] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.863606] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.863768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.863843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.864080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.864265] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.867490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.867490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.867490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.867490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.867490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.867490] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.867490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.867490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.867490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.867490] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.867490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.867490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.867490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.867490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.867490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.867490] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.885996] env[69656]: INFO networking_nsxv3.common.synchronization [req-f64de20e-526f-4b6d-a8b9-da3d86aa3156 req-16eb67cc-5aae-4713-b380-0d167a32f84b service nova] Enqueued Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGHEST for action security_group_rules [ 1140.886197] env[69656]: INFO networking_nsxv3.common.synchronization [req-f64de20e-526f-4b6d-a8b9-da3d86aa3156 req-16eb67cc-5aae-4713-b380-0d167a32f84b service nova] Enqueued Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGHEST for action security_group_members [ 1140.886338] env[69656]: INFO networking_nsxv3.common.synchronization [req-f64de20e-526f-4b6d-a8b9-da3d86aa3156 req-16eb67cc-5aae-4713-b380-0d167a32f84b service nova] Enqueued Resource ID: 285745bc-c421-49e0-86a6-50eb90a0c252 with Priority: HIGHEST for action port [ 1140.886939] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGHEST for action security_group_rules [ 1140.887921] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGHEST for action security_group_members [ 1140.888078] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 285745bc-c421-49e0-86a6-50eb90a0c252 with Priority: HIGHEST for action port [ 1140.888379] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-457b4cc0-32ad-4db2-819d-1a58cf1de954 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.888532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.888601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.888820] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.888904] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('457b4cc0-32ad-4db2-819d-1a58cf1de954',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.890759] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-457b4cc0-32ad-4db2-819d-1a58cf1de954 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.890904] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.890991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.891198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.891360] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.891464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.891565] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.891802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.891927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.895437] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('457b4cc0-32ad-4db2-819d-1a58cf1de954',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.896504] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-285745bc-c421-49e0-86a6-50eb90a0c252 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.896639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-285745bc-c421-49e0-86a6-50eb90a0c252" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.896724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-285745bc-c421-49e0-86a6-50eb90a0c252" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.896927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-285745bc-c421-49e0-86a6-50eb90a0c252" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.897050] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('285745bc-c421-49e0-86a6-50eb90a0c252',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.305581] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.305943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.305943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.306051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.306137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.306247] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 is going to be updated. [ 1141.336440] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.336579] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.336650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.336892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.337067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.349326] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: IN_PROGRESS for 2s [ 1141.369978] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d70c367d-ca7b-45b3-9579-5b05739f400a: rpc.has_security_group_logging(os_id): False [ 1141.388416] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.388416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.388416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.388416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.388416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.388416] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.388416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.388416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.388416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.388905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.388905] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.388905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.388905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.389064] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.389324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.389603] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.389712] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.389857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.390055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.390131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.390220] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d70c367d-ca7b-45b3-9579-5b05739f400a is going to be updated. [ 1141.398982] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('457b4cc0-32ad-4db2-819d-1a58cf1de954',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.403476] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-457b4cc0-32ad-4db2-819d-1a58cf1de954 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.403476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.405643] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 285745bc-c421-49e0-86a6-50eb90a0c252 with status ACTIVE [ 1141.405643] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.405643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.405643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.405643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.405643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.405643] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.405643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.405643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.405643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.405643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.405643] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.405643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.405643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.405643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.405643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.406448] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 285745bc-c421-49e0-86a6-50eb90a0c252 is going to be updated. [ 1141.424683] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.424954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.424954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.425141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.425280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.425438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-285745bc-c421-49e0-86a6-50eb90a0c252" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.450154] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.450309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.450375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.450581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.451025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.463743] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: IN_PROGRESS for 2s [ 1141.613945] env[69656]: INFO networking_nsxv3.common.synchronization [req-be634224-b59e-4426-a7ec-2920b2e75c8c req-bec831e5-4111-4845-83f1-f5ea9eac424f tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1141.614503] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1141.614829] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.614987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.616155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.616925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.617281] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.617373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.617422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.617623] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.617776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.617956] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.743622] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 in Status: SUCCESS [ 1141.743622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.743622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.743622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.745314] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.745472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.745552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.745970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.746049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.746123] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.746217] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10987214-e215-44cd-98d2-5bd627e6c0e2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.810029] env[69656]: INFO networking_nsxv3.common.synchronization [req-2468c5a8-a56d-47c4-b3de-91b04fda2f49 req-6ef58e75-b8ad-4dcd-b66d-620d3bdac309 tempest-ServerTagsTestJSON-224867736 tempest-ServerTagsTestJSON-224867736-project-member] Enqueued Resource ID: 012722d0-145e-4c53-8203-3606845f8f43 with Priority: HIGHEST for action security_group_members [ 1141.810561] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012722d0-145e-4c53-8203-3606845f8f43 with Priority: HIGHEST for action security_group_members [ 1141.811231] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-012722d0-145e-4c53-8203-3606845f8f43 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.811359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.811428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.811631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.811781] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.811881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.811944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.812970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.813104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.813190] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('012722d0-145e-4c53-8203-3606845f8f43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.904746] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('457b4cc0-32ad-4db2-819d-1a58cf1de954',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.940142] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.940142] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.940142] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.940142] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.940142] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.940142] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.940142] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.940902] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.941193] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.941516] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.941870] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.942150] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.942357] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.942559] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.942799] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.943059] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.965162] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.965162] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1141.965162] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.965162] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.965162] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-a37c0d93-dd19-4548-be13-7a46fbb987cf taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.965162] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-a37c0d93-dd19-4548-be13-7a46fbb987cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.965162] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-a37c0d93-dd19-4548-be13-7a46fbb987cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.965162] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-a37c0d93-dd19-4548-be13-7a46fbb987cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.965162] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a37c0d93-dd19-4548-be13-7a46fbb987cf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.120227] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.248609] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10987214-e215-44cd-98d2-5bd627e6c0e2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.316181] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.316181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.316181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.316181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.316718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.316718] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.316795] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.316872] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.317092] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.317250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.317402] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012722d0-145e-4c53-8203-3606845f8f43 is going to be updated. [ 1142.348393] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.348393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.348393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.348617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.348774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.357188] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012722d0-145e-4c53-8203-3606845f8f43 in Status: IN_PROGRESS for 2s [ 1142.408979] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.409163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.409281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.409511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.409624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.409729] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 is going to be created. [ 1142.430755] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.431122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.431122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.431258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.431447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.442014] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 in Status: UNINITIALIZED for 2s [ 1142.469675] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.469924] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.470229] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.470580] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.470855] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.471091] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port a37c0d93-dd19-4548-be13-7a46fbb987cf not found, creating... [ 1142.471390] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.471560] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.471684] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.471985] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.472223] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.472640] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.472873] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.473633] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.473633] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.473633] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.473633] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: a37c0d93-dd19-4548-be13-7a46fbb987cf is going to be created. [ 1142.492218] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.492515] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.492646] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.493138] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.493511] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.493772] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-a37c0d93-dd19-4548-be13-7a46fbb987cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.622933] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.751817] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10987214-e215-44cd-98d2-5bd627e6c0e2: rpc.has_security_group_logging(os_id): False [ 1142.769590] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.769859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.769940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.770237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.770445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.770712] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.770975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.771091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.771273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.771361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.771460] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 is going to be created. [ 1142.836226] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.836388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.836465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.836721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.836917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.850944] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 in Status: IN_PROGRESS for 2s [ 1143.125298] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.125470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.125548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.125751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.125837] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.125932] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1143.161479] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.161718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.161718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.161915] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.162082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.171110] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1143.220606] env[69656]: INFO networking_nsxv3.common.synchronization [req-be634224-b59e-4426-a7ec-2920b2e75c8c req-1464bbda-4d2a-4940-a202-befbc23662a9 service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 1143.220793] env[69656]: INFO networking_nsxv3.common.synchronization [req-be634224-b59e-4426-a7ec-2920b2e75c8c req-1464bbda-4d2a-4940-a202-befbc23662a9 service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1143.220992] env[69656]: INFO networking_nsxv3.common.synchronization [req-be634224-b59e-4426-a7ec-2920b2e75c8c req-1464bbda-4d2a-4940-a202-befbc23662a9 service nova] Enqueued Resource ID: a37c0d93-dd19-4548-be13-7a46fbb987cf with Priority: HIGHEST for action port [ 1143.221187] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 1143.221320] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1143.221457] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a37c0d93-dd19-4548-be13-7a46fbb987cf with Priority: HIGHEST for action port [ 1143.223382] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.223570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.223638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.223842] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.223930] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.224872] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.224960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.225478] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-a37c0d93-dd19-4548-be13-7a46fbb987cf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.225591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a37c0d93-dd19-4548-be13-7a46fbb987cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.225663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a37c0d93-dd19-4548-be13-7a46fbb987cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.225838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a37c0d93-dd19-4548-be13-7a46fbb987cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.225920] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a37c0d93-dd19-4548-be13-7a46fbb987cf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.360746] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: SUCCESS [ 1143.361080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.482216] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: SUCCESS [ 1143.482452] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.729020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.729020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.729020] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a37c0d93-dd19-4548-be13-7a46fbb987cf with status ACTIVE [ 1143.729020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.729020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.729020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.729539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.729539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.729539] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.729539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.729811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.729811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.729951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.730091] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.730326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.730326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.730496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.730496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.730496] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a37c0d93-dd19-4548-be13-7a46fbb987cf is going to be updated. [ 1143.751792] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.751792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.751919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.752130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.752273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.752440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a37c0d93-dd19-4548-be13-7a46fbb987cf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.369466] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012722d0-145e-4c53-8203-3606845f8f43 in Status: SUCCESS [ 1144.369725] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012722d0-145e-4c53-8203-3606845f8f43 deletion is rescheduled due to dependency. [ 1144.369834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.455985] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 in Status: SUCCESS [ 1144.456221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.456419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.456643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.456873] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.457022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.458033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.458033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.458033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.458033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.458033] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('457b4cc0-32ad-4db2-819d-1a58cf1de954',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.797431] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-539 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.797689] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-539" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.797847] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-539" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.798145] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-539" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.798424] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.798592] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.798715] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.798955] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.799129] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.799367] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.799481] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.799592] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.799701] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.799816] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.799951] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.800123] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.818377] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.818576] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1144.818727] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.819157] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-539" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.819271] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.819455] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.819581] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.819861] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.820012] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a58748e-6aa1-4f39-9cbd-9737aba3b4d2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.862038] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 in Status: SUCCESS [ 1144.862229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.960047] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('457b4cc0-32ad-4db2-819d-1a58cf1de954',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.180230] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1145.180525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.180743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.180986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.181297] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.181406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.181464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.181638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.181737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.181875] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.324295] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.324465] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.324835] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.325182] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.325379] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.325748] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.326014] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.326162] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.326469] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.326725] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.327147] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.327344] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.327540] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.327722] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.327868] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.328082] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 is going to be updated. [ 1145.354206] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.354501] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.354669] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.355022] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.355316] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.355580] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.463007] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 457b4cc0-32ad-4db2-819d-1a58cf1de954: rpc.has_security_group_logging(os_id): False [ 1145.485321] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.485523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.485523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.485707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.485794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.486048] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.486152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.486214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.486371] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.486460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.486559] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 is going to be created. [ 1145.556939] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.557151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.557263] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.557463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.557704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.568749] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 in Status: IN_PROGRESS for 2s [ 1145.684395] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.111034] env[69656]: INFO networking_nsxv3.common.synchronization [req-9a510d52-ffcc-429c-9492-1452660288f7 req-031e9a04-3512-4830-bcda-f9e52a71408c service nova] Enqueued Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_rules [ 1146.111295] env[69656]: INFO networking_nsxv3.common.synchronization [req-9a510d52-ffcc-429c-9492-1452660288f7 req-031e9a04-3512-4830-bcda-f9e52a71408c service nova] Enqueued Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 1146.111525] env[69656]: INFO networking_nsxv3.common.synchronization [req-9a510d52-ffcc-429c-9492-1452660288f7 req-031e9a04-3512-4830-bcda-f9e52a71408c service nova] Enqueued Resource ID: 4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 with Priority: HIGHEST for action port [ 1146.113493] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_rules [ 1146.113762] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 1146.114012] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 with Priority: HIGHEST for action port [ 1146.114368] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.114601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.114742] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.114991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.115213] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.120018] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.120018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.120018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.120336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.120495] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.120636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.120728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.121041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.121041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.121129] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.126094] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.126310] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.126310] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.126472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.126550] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a58748e-6aa1-4f39-9cbd-9737aba3b4d2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.187112] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.617638] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.617976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.626268] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.630468] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 with status ACTIVE [ 1146.630468] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.630468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.630468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.630669] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.630730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.630974] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.631111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.631171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.631635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.631635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.631635] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.631845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.631845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.631956] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.632050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.632282] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a58748e-6aa1-4f39-9cbd-9737aba3b4d2 is going to be updated. [ 1146.655892] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.656091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.656161] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.656408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.656569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.656733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a58748e-6aa1-4f39-9cbd-9737aba3b4d2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.689970] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.690133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.690213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.690580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.690764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.690828] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1146.734660] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.734849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.734849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.735045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.735219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.747164] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1147.128451] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.587424] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 in Status: SUCCESS [ 1147.589751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.632187] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.637035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.637035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.637035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.637035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.637035] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7976f89e-e748-4aab-bd17-3b945c409c8c is going to be updated. [ 1147.669931] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.670226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.670350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.670659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.670894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.686965] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: IN_PROGRESS for 2s [ 1148.758435] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1148.759296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.759296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.759405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.759665] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.759937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.760072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.760333] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.760456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.760614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.761301] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.264172] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.264172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.264172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.264172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.264439] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.264585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.264622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.264779] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.264862] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.264950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.265109] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.265194] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.265253] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.265404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.265523] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.265605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.265662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.265793] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.265869] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.265948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.266067] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.702167] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: SUCCESS [ 1149.702167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.702167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.702356] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.702758] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.702758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.702758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.702990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.703117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.703259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.703393] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.768416] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06966f07-554f-446e-a2a7-17a62c52a519: rpc.has_security_group_logging(os_id): False [ 1149.785343] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.785501] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.785664] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.785854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.785895] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.786089] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.786188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.786247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.786402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.786475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.786696] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.786802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.786873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.787870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.788614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.788614] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.788614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.788614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.788614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.788843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.788843] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1149.844975] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.845145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.845218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.845428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.845579] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.858059] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1150.209409] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.209584] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.209659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.209876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.210057] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.210161] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.210227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.210376] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.210560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.210560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.210686] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.210809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.210903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.211010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.211149] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.211231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.211292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.211419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.211498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.211578] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.211666] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.236836] env[69656]: INFO networking_nsxv3.common.synchronization [req-e328e932-7b9f-46d3-82ab-5b681c0f0b5d req-8851946b-6812-41d8-a573-1a8b3d4b524f tempest-ServersAdminNegativeTestJSON-2005902791 tempest-ServersAdminNegativeTestJSON-2005902791-project-member] Enqueued Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_members [ 1150.237256] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_members [ 1150.237608] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.237873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.237958] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.238188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.238355] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.238458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.238525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.240208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.240208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.240208] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.714928] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7976f89e-e748-4aab-bd17-3b945c409c8c: rpc.has_security_group_logging(os_id): False [ 1150.731643] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.731844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.731919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.732187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.732285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.732522] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.732653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.732702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.732971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.733118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.733393] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.733560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.733684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.733871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.733954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.734449] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.734628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.734751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.734974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.735156] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.735376] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7976f89e-e748-4aab-bd17-3b945c409c8c is going to be updated. [ 1150.741288] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.796084] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.796428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.797045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.797392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.797889] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.811617] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: IN_PROGRESS for 2s [ 1151.243773] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.746550] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.746734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.746773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.747063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.747171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.747271] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d70c367d-ca7b-45b3-9579-5b05739f400a is going to be updated. [ 1151.778017] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.778017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.778017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.778017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.778017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.790644] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: IN_PROGRESS for 2s [ 1151.872674] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1151.873021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.000095] env[69656]: INFO networking_nsxv3.common.synchronization [req-f18fc83a-e2fd-4105-83fc-11571334c9b7 req-18e14e5f-e264-4ccf-9cf7-54114cbde35e tempest-VolumesAdminNegativeTest-952299599 tempest-VolumesAdminNegativeTest-952299599-project-member] Enqueued Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGHEST for action security_group_members [ 1152.000636] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGHEST for action security_group_members [ 1152.001967] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-520db785-680d-4180-b916-bfbc19204d31 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.002192] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.002695] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.003465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.003761] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.004845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.005182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.005391] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.005992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.006431] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.509287] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.509443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.509527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.510222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.510222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.510222] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.510222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.510438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.510438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.510492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.510572] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 520db785-680d-4180-b916-bfbc19204d31 is going to be updated. [ 1152.536894] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.537183] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.537614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.537614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.537792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.545845] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 520db785-680d-4180-b916-bfbc19204d31 in Status: IN_PROGRESS for 2s [ 1152.830383] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: SUCCESS [ 1152.830627] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.804373] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: SUCCESS [ 1153.804373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.563379] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 520db785-680d-4180-b916-bfbc19204d31 in Status: SUCCESS [ 1154.563490] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 520db785-680d-4180-b916-bfbc19204d31 deletion is rescheduled due to dependency. [ 1154.563602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.463136] env[69656]: INFO networking_nsxv3.common.synchronization [req-c61390d3-8c22-4ca7-a81b-ae8f6397fee6 req-3a01c4b4-eb27-4edc-aa34-4243c44c2a37 tempest-ServerRescueTestJSON-710259377 tempest-ServerRescueTestJSON-710259377-project-member] Enqueued Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_members [ 1156.463652] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGHEST for action security_group_members [ 1156.463964] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.464104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.464171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.464366] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.464516] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.464975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.465068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.465238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.465303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.465398] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.969073] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.969295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.969569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.971493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.971493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.971493] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.971493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.971493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.971493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.971493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.971493] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 is going to be updated. [ 1157.001412] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.001578] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.001622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.002702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.002702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.014988] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: IN_PROGRESS for 2s [ 1158.117050] env[69656]: INFO networking_nsxv3.common.synchronization [req-be3e9e92-67f1-4ea8-8736-ed6ae2702ee2 req-40a099c2-0c88-4273-b281-b52f492e69b7 tempest-ServersAdminNegativeTestJSON-2005902791 tempest-ServersAdminNegativeTestJSON-2005902791-project-member] Enqueued Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_members [ 1158.117678] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70c367d-ca7b-45b3-9579-5b05739f400a with Priority: HIGHEST for action security_group_members [ 1158.122263] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70c367d-ca7b-45b3-9579-5b05739f400a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.122606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.122689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.123295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.123577] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.123750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.123852] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.124152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.124300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.124795] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d70c367d-ca7b-45b3-9579-5b05739f400a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.627555] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.629023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.629023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.629023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.629023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.629023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.629023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.629023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.629023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.629023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.629473] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d70c367d-ca7b-45b3-9579-5b05739f400a is going to be updated. [ 1158.663329] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.663504] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.663836] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.663908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.664069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.675833] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: IN_PROGRESS for 2s [ 1159.025196] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 in Status: SUCCESS [ 1159.025451] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 deletion is rescheduled due to dependency. [ 1159.025574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.685952] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70c367d-ca7b-45b3-9579-5b05739f400a in Status: SUCCESS [ 1160.686278] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d70c367d-ca7b-45b3-9579-5b05739f400a deletion is rescheduled due to dependency. [ 1160.686339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70c367d-ca7b-45b3-9579-5b05739f400a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.910974] env[69656]: INFO networking_nsxv3.common.synchronization [req-93804dec-cf32-4283-9198-7439e41de1a8 req-b7731f3d-711d-4541-94cc-61cf6d921a08 tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 with Priority: HIGHEST for action security_group_members [ 1160.911857] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 with Priority: HIGHEST for action security_group_members [ 1160.912362] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-77d2c3a5-526e-400a-8792-5423d2e6c534 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.912686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.912871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.913225] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.913531] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.913795] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.914018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.914336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.915776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.915776] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77d2c3a5-526e-400a-8792-5423d2e6c534',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.419881] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.419881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.419881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.419881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.441202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.441439] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.441558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.441613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.441978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.441978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.441978] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 is going to be updated. [ 1161.467728] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.467865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.467935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.468904] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.468904] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.476085] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 in Status: IN_PROGRESS for 2s [ 1161.521349] env[69656]: INFO networking_nsxv3.common.synchronization [req-4cf4a5ba-22f3-4652-9d86-b731bf1ecdf7 req-9b9d8a3f-eccc-4c79-8d79-fa1b181f64df tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1161.521913] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1161.522239] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.522361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.522426] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.522621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.522764] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.522860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.522922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.523116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.523224] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.523337] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.877251] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.879041] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.879041] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.879041] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.879041] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.879041] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.879041] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.879255] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.879403] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.879623] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.879753] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1161.882578] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1161.882770] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1161.882841] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.883007] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1161.883206] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1161.901064] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1161.901287] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1161.901434] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1161.901637] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.901981] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-690559b0-ce8d-46ea-aa95-2e81608044c9 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.902222] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-690559b0-ce8d-46ea-aa95-2e81608044c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.902500] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-690559b0-ce8d-46ea-aa95-2e81608044c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.903396] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-690559b0-ce8d-46ea-aa95-2e81608044c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.903548] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('690559b0-ce8d-46ea-aa95-2e81608044c9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.025249] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.407198] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.407432] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.407563] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.407841] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.407996] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.408202] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 690559b0-ce8d-46ea-aa95-2e81608044c9 not found, creating... [ 1162.408438] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.408915] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.408915] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.408998] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.409122] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.409404] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.410154] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.410154] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.410154] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.410154] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.410412] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 690559b0-ce8d-46ea-aa95-2e81608044c9 is going to be created. [ 1162.429526] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.430710] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.430835] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.431671] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.431671] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.431671] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-690559b0-ce8d-46ea-aa95-2e81608044c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.530372] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.033216] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.033502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.033502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.033691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.034054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.034054] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1163.063115] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.063290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.063372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.063596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.063749] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.082963] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1163.130924] env[69656]: INFO networking_nsxv3.common.synchronization [req-4cf4a5ba-22f3-4652-9d86-b731bf1ecdf7 req-7f00c271-80aa-43fa-aca1-419dfb45c193 service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 1163.131159] env[69656]: INFO networking_nsxv3.common.synchronization [req-4cf4a5ba-22f3-4652-9d86-b731bf1ecdf7 req-7f00c271-80aa-43fa-aca1-419dfb45c193 service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1163.131268] env[69656]: INFO networking_nsxv3.common.synchronization [req-4cf4a5ba-22f3-4652-9d86-b731bf1ecdf7 req-7f00c271-80aa-43fa-aca1-419dfb45c193 service nova] Enqueued Resource ID: 690559b0-ce8d-46ea-aa95-2e81608044c9 with Priority: HIGHEST for action port [ 1163.131496] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 1163.131623] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1163.131717] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690559b0-ce8d-46ea-aa95-2e81608044c9 with Priority: HIGHEST for action port [ 1163.132298] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.132440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.132509] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.132702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.133122] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.133924] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.134048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.134268] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-690559b0-ce8d-46ea-aa95-2e81608044c9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.134487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-690559b0-ce8d-46ea-aa95-2e81608044c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.134558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-690559b0-ce8d-46ea-aa95-2e81608044c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.134728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-690559b0-ce8d-46ea-aa95-2e81608044c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.134798] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('690559b0-ce8d-46ea-aa95-2e81608044c9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.485881] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 in Status: SUCCESS [ 1163.486116] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77d2c3a5-526e-400a-8792-5423d2e6c534 deletion is rescheduled due to dependency. [ 1163.486245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77d2c3a5-526e-400a-8792-5423d2e6c534" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.636468] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 690559b0-ce8d-46ea-aa95-2e81608044c9 with status ACTIVE [ 1163.636712] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.636845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.636912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.637163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.637252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.637434] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.637529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.637589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.637734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.637807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.637984] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.638098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.638157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.638293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.638364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.638447] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 690559b0-ce8d-46ea-aa95-2e81608044c9 is going to be updated. [ 1163.639581] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.639676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.670440] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.671300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.671300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.671300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.671300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.671300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-690559b0-ce8d-46ea-aa95-2e81608044c9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.092924] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1165.093268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.093421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.093659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.093846] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.094673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.094673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.094673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.094673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.094673] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.183606] env[69656]: INFO networking_nsxv3.common.synchronization [None req-973b27e1-d8af-4f29-9e6e-cfa13fb90f26 None None] Enqueued Resource ID: f60874af-a462-4eaf-b4d4-f316caf8b55d with Priority: HIGHEST for action port [ 1165.184326] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f60874af-a462-4eaf-b4d4-f316caf8b55d with Priority: HIGHEST for action port [ 1165.184668] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-f60874af-a462-4eaf-b4d4-f316caf8b55d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.184850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f60874af-a462-4eaf-b4d4-f316caf8b55d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.184942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f60874af-a462-4eaf-b4d4-f316caf8b55d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.185644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f60874af-a462-4eaf-b4d4-f316caf8b55d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.185877] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f60874af-a462-4eaf-b4d4-f316caf8b55d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.604026] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.690873] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f60874af-a462-4eaf-b4d4-f316caf8b55d [ 1165.690873] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.690873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.690873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.690873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.690873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.690873] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f60874af-a462-4eaf-b4d4-f316caf8b55d already deleted. [ 1165.690873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f60874af-a462-4eaf-b4d4-f316caf8b55d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.104667] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.331952] env[69656]: INFO networking_nsxv3.common.synchronization [req-346eb578-a19d-4195-8624-66760ba9a59a req-17405c47-7669-4603-a224-650865be4ae8 tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 with Priority: HIGHEST for action security_group_members [ 1166.333280] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 with Priority: HIGHEST for action security_group_members [ 1166.333382] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0e73dee-afe4-4a44-9672-c68cc0af0557 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.333860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.333860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.334124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.334200] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.334399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.335667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.335922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.336078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.336788] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0e73dee-afe4-4a44-9672-c68cc0af0557',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.590244] env[69656]: INFO networking_nsxv3.common.synchronization [None req-cd135c5b-2658-474e-8b70-594928ad2b1e tempest-ServersTestManualDisk-1181081679 tempest-ServersTestManualDisk-1181081679-project-member] Enqueued Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGHEST for action security_group_rules [ 1166.591016] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGHEST for action security_group_rules [ 1166.592655] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc5eb60b-e0f7-414b-a660-add25da9efa7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.592810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.592878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.593638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.593638] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc5eb60b-e0f7-414b-a660-add25da9efa7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.607209] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.610512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.610512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.610512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.610512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.610512] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1166.637382] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.637382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.637382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.637382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.637382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.644117] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1166.710293] env[69656]: INFO networking_nsxv3.common.synchronization [None req-2086ecb1-1089-43b2-a20b-4dade798e177 tempest-ServersTestManualDisk-1181081679 tempest-ServersTestManualDisk-1181081679-project-member] Enqueued Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGHEST for action security_group_rules [ 1166.710293] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGHEST for action security_group_rules [ 1166.710293] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc5eb60b-e0f7-414b-a660-add25da9efa7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.710563] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.839138] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.839338] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.839822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.841806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.841806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.841806] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.841806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.841806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.841806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.841806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.842288] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 is going to be updated. [ 1166.867174] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.867325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.867594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.867594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.867793] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.875107] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 in Status: IN_PROGRESS for 2s [ 1167.115851] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.116173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.116173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.116285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.116404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.116542] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 already deleted. [ 1167.117237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.117237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.117237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.117237] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc5eb60b-e0f7-414b-a660-add25da9efa7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.636358] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.636525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.636565] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.636760] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.636844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.637016] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 already deleted. [ 1167.637016] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.805916] env[69656]: INFO networking_nsxv3.common.synchronization [None req-7fb4e474-1d26-4943-9eac-50726b147ca0 None None] Enqueued Resource ID: f02b1b8a-a4f9-44d1-8c28-12c9da1b4ba5 with Priority: HIGHEST for action port [ 1167.806515] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f02b1b8a-a4f9-44d1-8c28-12c9da1b4ba5 with Priority: HIGHEST for action port [ 1167.806890] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-f02b1b8a-a4f9-44d1-8c28-12c9da1b4ba5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.807021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f02b1b8a-a4f9-44d1-8c28-12c9da1b4ba5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.807092] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f02b1b8a-a4f9-44d1-8c28-12c9da1b4ba5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.809866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f02b1b8a-a4f9-44d1-8c28-12c9da1b4ba5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.809866] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f02b1b8a-a4f9-44d1-8c28-12c9da1b4ba5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.311823] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f02b1b8a-a4f9-44d1-8c28-12c9da1b4ba5 [ 1168.312232] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.312389] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.312457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.312667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.312767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.313668] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f02b1b8a-a4f9-44d1-8c28-12c9da1b4ba5 already deleted. [ 1168.313668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f02b1b8a-a4f9-44d1-8c28-12c9da1b4ba5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.655136] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1168.655377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.655552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.655820] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.655999] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.656158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.656242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.656415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.656498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.656591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.656673] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.885481] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 in Status: SUCCESS [ 1168.885660] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0e73dee-afe4-4a44-9672-c68cc0af0557 deletion is rescheduled due to dependency. [ 1168.885784] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0e73dee-afe4-4a44-9672-c68cc0af0557" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.158970] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.159208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.159284] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.159554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.159662] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.160034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.160034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.160034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.160034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.160330] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.160330] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.160330] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.160486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.160529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.160653] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.160743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.160803] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.160929] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.161064] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.161131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.161304] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.666531] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06966f07-554f-446e-a2a7-17a62c52a519: rpc.has_security_group_logging(os_id): False [ 1169.684235] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.684384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.684476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.684982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.684982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.684982] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.685158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.685158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.685290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.685346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.685542] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.685639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.685690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.685832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.685905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.686110] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.686226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.686272] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.686458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.686541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.686628] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1169.779205] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.779435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.779435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.779604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.779807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.794423] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1171.808620] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1171.808857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.808636] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1172.808636] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1174.132401] env[69656]: INFO networking_nsxv3.common.synchronization [req-f9ad7148-e3a0-4635-823f-4807e48a1ee9 req-56d5f9b6-a91d-451f-9bd6-f14e28e1dea7 tempest-DeleteServersTestJSON-708906239 tempest-DeleteServersTestJSON-708906239-project-member] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1174.132918] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1174.133375] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.133516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.133585] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.133778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.133929] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.134032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.134104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.135123] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.135277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.135418] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.638629] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.638846] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.638950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.639276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.639408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.639671] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.639833] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.639896] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.640128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.640244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.640363] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1174.667121] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.668104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.668104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.668104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.668104] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.675845] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1176.687437] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1176.687800] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 deletion is rescheduled due to dependency. [ 1176.687800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.796639] env[69656]: INFO networking_nsxv3.common.synchronization [req-b9754917-7e12-4457-a785-2db3c3759400 req-14dc2cf7-931b-43eb-93cc-52729e6dd88e tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1176.797134] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1176.797438] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.797559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.797626] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.797813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.797957] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.798097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.798163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.798320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.798404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.798513] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.300766] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.803415] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.305678] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.305916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.306028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.306894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.306894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.306894] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1178.313110] env[69656]: INFO networking_nsxv3.common.synchronization [req-e5ac215f-0554-4a06-b956-1df2aae1af9b req-ad4c59ef-05ca-40e6-91e3-8f429191b0fe tempest-ServersTestManualDisk-1181081679 tempest-ServersTestManualDisk-1181081679-project-member] Enqueued Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGHEST for action security_group_members [ 1178.313625] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGHEST for action security_group_members [ 1178.314596] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc5eb60b-e0f7-414b-a660-add25da9efa7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.314730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.314800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.315109] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.315210] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.315379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.315462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.315839] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.316034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.316105] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc5eb60b-e0f7-414b-a660-add25da9efa7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.340743] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.340948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.340948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.341278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.341413] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.350680] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1178.794209] env[69656]: INFO networking_nsxv3.common.synchronization [req-323c93d6-cdbf-4be1-bf1a-299f527341e2 req-96919877-bbcf-4347-9c3b-2e4ba61ac70a tempest-ServersNegativeTestJSON-1253990888 tempest-ServersNegativeTestJSON-1253990888-project-member] Enqueued Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 1178.794497] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGHEST for action security_group_members [ 1178.795281] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.795281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.795281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.795281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.795511] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.795560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.795594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.795725] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.795809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.795900] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.817418] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.817693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.817693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.817780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.817866] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.818058] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.818158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.818221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.818368] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.818443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.818526] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 already deleted. [ 1178.818603] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.834669] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-945 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.834867] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-945" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.835013] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-945" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.835354] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-945" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.835644] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.835817] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.835942] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.836178] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.836328] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.836540] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1178.836661] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1178.836783] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1178.836946] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1178.837025] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1178.837140] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1178.837276] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1178.855492] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1178.855651] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1178.855789] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1178.855950] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-945" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.856246] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-b6652498-e6f4-4b84-b1c8-f787f93baf00 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.856415] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-b6652498-e6f4-4b84-b1c8-f787f93baf00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.856535] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-b6652498-e6f4-4b84-b1c8-f787f93baf00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.856823] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-b6652498-e6f4-4b84-b1c8-f787f93baf00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.856967] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6652498-e6f4-4b84-b1c8-f787f93baf00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.298323] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.298484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.298553] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.298780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.298877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.299164] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.299283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.299283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.299404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.299481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.299566] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7976f89e-e748-4aab-bd17-3b945c409c8c is going to be updated. [ 1179.325028] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.325174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.325244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.325489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.325646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.333835] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: IN_PROGRESS for 2s [ 1179.359431] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.359651] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.360146] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.360647] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.360913] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.361174] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port b6652498-e6f4-4b84-b1c8-f787f93baf00 not found, creating... [ 1179.361479] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.361661] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.361786] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.362052] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.362207] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.362508] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.362674] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.362798] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.363029] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.363172] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.363352] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: b6652498-e6f4-4b84-b1c8-f787f93baf00 is going to be created. [ 1179.380217] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.380421] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.380528] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.380773] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.381027] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.381299] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-b6652498-e6f4-4b84-b1c8-f787f93baf00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.055345] env[69656]: INFO networking_nsxv3.common.synchronization [req-e5ac215f-0554-4a06-b956-1df2aae1af9b req-a0931cd1-2cf4-4bf3-9548-242ec8d1b1d9 service nova] Enqueued Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGHEST for action security_group_rules [ 1180.055687] env[69656]: INFO networking_nsxv3.common.synchronization [req-e5ac215f-0554-4a06-b956-1df2aae1af9b req-a0931cd1-2cf4-4bf3-9548-242ec8d1b1d9 service nova] Enqueued Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGHEST for action security_group_members [ 1180.056027] env[69656]: INFO networking_nsxv3.common.synchronization [req-e5ac215f-0554-4a06-b956-1df2aae1af9b req-a0931cd1-2cf4-4bf3-9548-242ec8d1b1d9 service nova] Enqueued Resource ID: b6652498-e6f4-4b84-b1c8-f787f93baf00 with Priority: HIGHEST for action port [ 1180.056230] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGHEST for action security_group_rules [ 1180.056363] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGHEST for action security_group_members [ 1180.056459] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6652498-e6f4-4b84-b1c8-f787f93baf00 with Priority: HIGHEST for action port [ 1180.056725] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc5eb60b-e0f7-414b-a660-add25da9efa7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.056851] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.056940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.058250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.058348] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc5eb60b-e0f7-414b-a660-add25da9efa7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.059350] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc5eb60b-e0f7-414b-a660-add25da9efa7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.059350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.059485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.059856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.059856] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.059856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.059856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.060050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.060084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.063977] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc5eb60b-e0f7-414b-a660-add25da9efa7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.063977] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6652498-e6f4-4b84-b1c8-f787f93baf00 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.063977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6652498-e6f4-4b84-b1c8-f787f93baf00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.063977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6652498-e6f4-4b84-b1c8-f787f93baf00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.063977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6652498-e6f4-4b84-b1c8-f787f93baf00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.063977] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6652498-e6f4-4b84-b1c8-f787f93baf00',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.359739] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1180.359739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.562539] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc5eb60b-e0f7-414b-a660-add25da9efa7 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.562663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.565164] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc5eb60b-e0f7-414b-a660-add25da9efa7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.566140] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6652498-e6f4-4b84-b1c8-f787f93baf00 with status ACTIVE [ 1180.566312] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.566520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.566594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.566800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.566893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.567087] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.567231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.567278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.567444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.567533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.567755] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.567845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.567845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.568172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.568172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.568172] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6652498-e6f4-4b84-b1c8-f787f93baf00 is going to be updated. [ 1180.593021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.593174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.593279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.593451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.593589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.593739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6652498-e6f4-4b84-b1c8-f787f93baf00" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.070770] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc5eb60b-e0f7-414b-a660-add25da9efa7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.311952] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-152 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.312185] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.312371] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.312687] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.312993] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.313766] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.313911] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.314151] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.314406] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.314987] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.315133] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.315254] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.315372] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.315491] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.315603] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.315776] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1181.346893] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7976f89e-e748-4aab-bd17-3b945c409c8c in Status: SUCCESS [ 1181.347094] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7976f89e-e748-4aab-bd17-3b945c409c8c deletion is rescheduled due to dependency. [ 1181.347240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.348184] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1181.348500] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1181.348621] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1181.348814] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.353290] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-df0faae1-9447-43e7-9ebd-353219d3f5c5 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.353655] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.353810] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.354102] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.354273] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df0faae1-9447-43e7-9ebd-353219d3f5c5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.572831] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.572992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.573120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.573399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.573493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.573594] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 is going to be created. [ 1181.597518] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.597718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.597785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.597985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.598152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.606827] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 in Status: UNINITIALIZED for 2s [ 1181.857181] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.857438] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.857574] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.857861] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.858026] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.858330] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.858492] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.858613] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.858833] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.858976] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.859275] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.859438] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.859560] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.859770] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.859910] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.860065] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: df0faae1-9447-43e7-9ebd-353219d3f5c5 is going to be updated. [ 1181.884049] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.884792] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.884792] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.884905] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.885046] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.885280] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.988138] env[69656]: INFO networking_nsxv3.common.synchronization [req-4682be4b-9e77-4671-8107-73b78ff476f9 req-bb87de35-de7e-4742-8817-53a9c8eb5651 service nova] Enqueued Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_rules [ 1182.988409] env[69656]: INFO networking_nsxv3.common.synchronization [req-4682be4b-9e77-4671-8107-73b78ff476f9 req-bb87de35-de7e-4742-8817-53a9c8eb5651 service nova] Enqueued Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_members [ 1182.988466] env[69656]: INFO networking_nsxv3.common.synchronization [req-4682be4b-9e77-4671-8107-73b78ff476f9 req-bb87de35-de7e-4742-8817-53a9c8eb5651 service nova] Enqueued Resource ID: df0faae1-9447-43e7-9ebd-353219d3f5c5 with Priority: HIGHEST for action port [ 1182.988691] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_rules [ 1182.988866] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_members [ 1182.988969] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0faae1-9447-43e7-9ebd-353219d3f5c5 with Priority: HIGHEST for action port [ 1182.989508] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.989629] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.989694] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.989889] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.989965] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.992067] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.992156] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.992456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.992521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.992649] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.992750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.992812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.992960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.993102] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.993213] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.993975] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-df0faae1-9447-43e7-9ebd-353219d3f5c5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.995028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.995028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.995028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.995028] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df0faae1-9447-43e7-9ebd-353219d3f5c5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.235305] env[69656]: INFO networking_nsxv3.common.synchronization [req-1a11f7b3-79d6-417b-b62d-559072044f82 req-49db4854-fde6-495d-a863-47a278adc0da tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGHEST for action security_group_members [ 1183.235834] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGHEST for action security_group_members [ 1183.236736] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3746f1b2-61cd-415b-a74b-1d4da3f9731f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.236736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.236736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.236736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.236736] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.236736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.237145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.237259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.237364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.237448] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3746f1b2-61cd-415b-a74b-1d4da3f9731f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.496536] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.497921] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.498069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.498208] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df0faae1-9447-43e7-9ebd-353219d3f5c5 with status ACTIVE [ 1183.498380] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.498488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.498553] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.498766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.498852] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.499167] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.499314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.500617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.500617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.500617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.500617] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.500617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.500617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.500617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.500617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.500617] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df0faae1-9447-43e7-9ebd-353219d3f5c5 is going to be updated. [ 1183.523227] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.523993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.523993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.523993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.523993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.523993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df0faae1-9447-43e7-9ebd-353219d3f5c5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.628687] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 in Status: SUCCESS [ 1183.628910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.629088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.629374] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.629498] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.629618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.629683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.629840] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.629922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.630013] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.630117] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc5eb60b-e0f7-414b-a660-add25da9efa7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.739251] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.739441] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.739556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.739763] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.761492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.761755] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.761876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.761941] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.762154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.762229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.762317] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f is going to be updated. [ 1183.786803] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.786803] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.786803] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.787017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.787058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.795628] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f in Status: IN_PROGRESS for 2s [ 1184.002130] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.133983] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc5eb60b-e0f7-414b-a660-add25da9efa7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.509470] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.509662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.509713] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.509920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.510017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.510185] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 is going to be updated. [ 1184.542961] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.542961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.542961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.542961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.542961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.550789] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 in Status: IN_PROGRESS for 2s [ 1184.636201] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc5eb60b-e0f7-414b-a660-add25da9efa7: rpc.has_security_group_logging(os_id): False [ 1184.664516] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.664673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.664767] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.664941] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.665042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.665283] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.665376] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.665433] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.665640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.665728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.665770] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 is going to be created. [ 1184.733827] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.733827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.733827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.734120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.734157] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.745478] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 in Status: IN_PROGRESS for 2s [ 1185.804554] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f in Status: SUCCESS [ 1185.804873] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f deletion is rescheduled due to dependency. [ 1185.804954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.952282] env[69656]: INFO networking_nsxv3.common.synchronization [req-826aaea6-c4b5-431a-ae86-ec6c21294715 req-5bbaff8f-42d2-48f1-a281-8d794e200ac2 tempest-ServerDiskConfigTestJSON-2110996415 tempest-ServerDiskConfigTestJSON-2110996415-project-member] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1185.952755] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1185.953079] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.953204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.953267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.953526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.953999] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.954527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.954527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.954527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.954527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.954700] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.459707] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.459707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.459707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.459707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.459707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.459707] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.459707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.459707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.459707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.459707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.459707] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 1186.488317] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.488317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.488317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.488317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.488317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.494942] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 1186.565762] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 in Status: SUCCESS [ 1186.565762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.565762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.565762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.565762] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.565762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.565762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.565762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.565762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.566262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.566502] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.757176] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 in Status: SUCCESS [ 1186.757465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.802177] env[69656]: INFO networking_nsxv3.common.synchronization [req-4295e0f6-3289-47cf-968f-4e74f81100bb req-69d138da-c54c-4966-8522-29a913ea9072 tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_members [ 1186.802712] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_members [ 1186.802981] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.803428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.803428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.803428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.803575] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.803646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.803711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.804497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.804497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.804497] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.068891] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.187472] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.187669] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.187793] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.188123] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.188328] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.188488] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.188607] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.188820] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.188963] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.189185] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.189301] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.189414] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.189524] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.189668] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.189732] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.189864] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.209036] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.209258] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1187.209364] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.209521] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.209842] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-f752fc17-1c5b-4074-913b-997feb0d19a6 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.210030] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-f752fc17-1c5b-4074-913b-997feb0d19a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.210160] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-f752fc17-1c5b-4074-913b-997feb0d19a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.210470] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-f752fc17-1c5b-4074-913b-997feb0d19a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.210616] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f752fc17-1c5b-4074-913b-997feb0d19a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.306560] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.306822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.306920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.307724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.327676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.328341] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.328341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.328341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.328679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.328679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.328679] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b is going to be updated. [ 1187.340883] env[69656]: INFO networking_nsxv3.common.synchronization [req-79dc5de1-f81e-4a39-8dd2-c00555791df0 req-53bcc91c-86ea-4cea-b224-463ff865c74a tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1187.341536] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1187.341912] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.342850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.342850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.342850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.342850] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.343063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.343063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.343502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.343502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.343502] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.356628] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.356628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.356628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.357024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.357024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.365631] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: IN_PROGRESS for 2s [ 1187.571021] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0b372e3-dc4f-48b1-9e79-f3de5b63e563: rpc.has_security_group_logging(os_id): False [ 1187.588087] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.588087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.588087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.588319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.588319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.588575] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.588679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.588742] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.588892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.589166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.589166] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 is going to be updated. [ 1187.605336] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.605568] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.605728] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.606052] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.606323] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.606518] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.606638] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.606873] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.607095] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.607337] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.607755] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.607927] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.608070] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.608207] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.608320] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.608468] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.624703] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.624874] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1187.625030] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.625214] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.625528] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-6dc98112-11c2-44c9-b6dd-f41443ac63c4 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.625738] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-6dc98112-11c2-44c9-b6dd-f41443ac63c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.625870] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-6dc98112-11c2-44c9-b6dd-f41443ac63c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.626205] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-6dc98112-11c2-44c9-b6dd-f41443ac63c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.626373] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dc98112-11c2-44c9-b6dd-f41443ac63c4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.644826] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.645031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.645031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.645252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.645396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.660332] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 in Status: IN_PROGRESS for 2s [ 1187.717411] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.717709] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.717845] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.718154] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.718315] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.718476] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port f752fc17-1c5b-4074-913b-997feb0d19a6 not found, creating... [ 1187.718750] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.718911] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.719049] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.719317] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.719459] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.719698] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.719859] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.720031] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.720220] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.720359] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.720502] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: f752fc17-1c5b-4074-913b-997feb0d19a6 is going to be created. [ 1187.755744] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.756047] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.756250] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.756616] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.756951] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.757292] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-f752fc17-1c5b-4074-913b-997feb0d19a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.846504] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.846869] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.846869] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.846958] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.847097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.847330] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.847424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.847505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.847670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.847754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.847856] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e already deleted. [ 1187.847953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.129465] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.129767] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.129947] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.130298] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.130460] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.130623] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 6dc98112-11c2-44c9-b6dd-f41443ac63c4 not found, creating... [ 1188.130882] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.131115] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.131264] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.131488] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.131651] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.132016] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.132240] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.132445] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.132679] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.132835] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.132989] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 6dc98112-11c2-44c9-b6dd-f41443ac63c4 is going to be created. [ 1188.159034] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.159034] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.159034] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.159268] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.159507] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.159712] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-6dc98112-11c2-44c9-b6dd-f41443ac63c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.505356] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 1188.505356] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b deletion is rescheduled due to dependency. [ 1188.505356] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.519168] env[69656]: INFO networking_nsxv3.common.synchronization [req-4295e0f6-3289-47cf-968f-4e74f81100bb req-9c44b883-25d5-4997-820a-d46a8226a09c service nova] Enqueued Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_rules [ 1188.519168] env[69656]: INFO networking_nsxv3.common.synchronization [req-4295e0f6-3289-47cf-968f-4e74f81100bb req-9c44b883-25d5-4997-820a-d46a8226a09c service nova] Enqueued Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_members [ 1188.519168] env[69656]: INFO networking_nsxv3.common.synchronization [req-4295e0f6-3289-47cf-968f-4e74f81100bb req-9c44b883-25d5-4997-820a-d46a8226a09c service nova] Enqueued Resource ID: f752fc17-1c5b-4074-913b-997feb0d19a6 with Priority: HIGHEST for action port [ 1188.519168] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_rules [ 1188.519168] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_members [ 1188.519168] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f752fc17-1c5b-4074-913b-997feb0d19a6 with Priority: HIGHEST for action port [ 1188.519168] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.519168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.519168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.519887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.520109] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.521075] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.521382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.522459] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-f752fc17-1c5b-4074-913b-997feb0d19a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.522699] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f752fc17-1c5b-4074-913b-997feb0d19a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.522917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f752fc17-1c5b-4074-913b-997feb0d19a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.523948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f752fc17-1c5b-4074-913b-997feb0d19a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.524208] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f752fc17-1c5b-4074-913b-997feb0d19a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.916810] env[69656]: INFO networking_nsxv3.common.synchronization [req-d2ca74f5-cd50-431f-8edf-3e8c46ddbb03 req-fcb5f35e-0515-4d87-b7c3-c3b4f8eb2ffd tempest-DeleteServersTestJSON-708906239 tempest-DeleteServersTestJSON-708906239-project-member] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1188.916810] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1188.917463] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.917463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.917463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.917463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.917708] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.917708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.917823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.917923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.917966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.926144] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.027206] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.027372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.027507] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f752fc17-1c5b-4074-913b-997feb0d19a6 with status ACTIVE [ 1189.027643] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.027752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.027810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.028031] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.028118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.028290] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.028384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.028445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.028592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.028669] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.028848] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.028937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.028987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.029141] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.029214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.029296] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f752fc17-1c5b-4074-913b-997feb0d19a6 is going to be updated. [ 1189.048610] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.048736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.048736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.049019] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.049252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.049398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f752fc17-1c5b-4074-913b-997feb0d19a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.307818] env[69656]: INFO networking_nsxv3.common.synchronization [req-79dc5de1-f81e-4a39-8dd2-c00555791df0 req-0f70553d-ced9-4528-a40d-054159980075 service nova] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_rules [ 1189.307994] env[69656]: INFO networking_nsxv3.common.synchronization [req-79dc5de1-f81e-4a39-8dd2-c00555791df0 req-0f70553d-ced9-4528-a40d-054159980075 service nova] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1189.308148] env[69656]: INFO networking_nsxv3.common.synchronization [req-79dc5de1-f81e-4a39-8dd2-c00555791df0 req-0f70553d-ced9-4528-a40d-054159980075 service nova] Enqueued Resource ID: 6dc98112-11c2-44c9-b6dd-f41443ac63c4 with Priority: HIGHEST for action port [ 1189.308373] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_rules [ 1189.308494] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1189.308883] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dc98112-11c2-44c9-b6dd-f41443ac63c4 with Priority: HIGHEST for action port [ 1189.309258] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.309517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.309584] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.309834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.309915] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.311230] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.311360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.311423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.311592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.311741] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.311834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.311953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.312036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.312120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.312207] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.313286] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dc98112-11c2-44c9-b6dd-f41443ac63c4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.313453] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dc98112-11c2-44c9-b6dd-f41443ac63c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.313526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dc98112-11c2-44c9-b6dd-f41443ac63c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.313630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dc98112-11c2-44c9-b6dd-f41443ac63c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.313694] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dc98112-11c2-44c9-b6dd-f41443ac63c4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.376765] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: SUCCESS [ 1189.376765] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b deletion is rescheduled due to dependency. [ 1189.376765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.376765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.376765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.377093] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.377093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.377093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.377244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.377367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.377505] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.381851] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.382070] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.382811] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.382811] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.382811] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.383213] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.383213] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.383213] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.383419] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.383647] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.383769] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.383869] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.383978] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.384158] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.384275] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.384437] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.399632] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.399804] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.015 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1189.399960] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.400223] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.400439] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-fb78d5f2-49f0-49c4-b699-a11a7ed5283f taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.400618] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-fb78d5f2-49f0-49c4-b699-a11a7ed5283f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.400744] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-fb78d5f2-49f0-49c4-b699-a11a7ed5283f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.401075] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-fb78d5f2-49f0-49c4-b699-a11a7ed5283f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.401222] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb78d5f2-49f0-49c4-b699-a11a7ed5283f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.426940] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.427186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.427348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.427551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.427665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.427903] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.428085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.428170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.428339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.428403] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.428484] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1189.452521] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.452694] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.452770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.452995] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.453152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.460831] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1189.673271] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 in Status: SUCCESS [ 1189.673609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.812316] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.812316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.815725] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6dc98112-11c2-44c9-b6dd-f41443ac63c4 with status ACTIVE [ 1189.815885] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.816034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.816123] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.816292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.816383] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.817073] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.817073] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.817073] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.817073] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.817073] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.817515] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.817515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.817515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.817515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.817515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.817515] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6dc98112-11c2-44c9-b6dd-f41443ac63c4 is going to be updated. [ 1189.819194] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.843065] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.843162] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.843202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.843405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.843552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.843722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dc98112-11c2-44c9-b6dd-f41443ac63c4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.880143] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.904301] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.904398] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.904957] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.904957] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.905089] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.905156] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port fb78d5f2-49f0-49c4-b699-a11a7ed5283f not found, creating... [ 1189.905440] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.905608] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.905803] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.906048] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.906197] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.906679] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.906961] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.907125] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.907344] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.907486] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.907630] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: fb78d5f2-49f0-49c4-b699-a11a7ed5283f is going to be created. [ 1189.929331] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.929641] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.929678] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.929906] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.930146] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.930374] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-fb78d5f2-49f0-49c4-b699-a11a7ed5283f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.321857] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.383188] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.707503] env[69656]: INFO networking_nsxv3.common.synchronization [req-d2ca74f5-cd50-431f-8edf-3e8c46ddbb03 req-773b3e7f-a70c-4d7e-9047-d98b189e2e47 service nova] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_rules [ 1190.707822] env[69656]: INFO networking_nsxv3.common.synchronization [req-d2ca74f5-cd50-431f-8edf-3e8c46ddbb03 req-773b3e7f-a70c-4d7e-9047-d98b189e2e47 service nova] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1190.707922] env[69656]: INFO networking_nsxv3.common.synchronization [req-d2ca74f5-cd50-431f-8edf-3e8c46ddbb03 req-773b3e7f-a70c-4d7e-9047-d98b189e2e47 service nova] Enqueued Resource ID: fb78d5f2-49f0-49c4-b699-a11a7ed5283f with Priority: HIGHEST for action port [ 1190.708147] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_rules [ 1190.708281] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1190.708378] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb78d5f2-49f0-49c4-b699-a11a7ed5283f with Priority: HIGHEST for action port [ 1190.709360] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.709544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.709544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.710015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.710015] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.710715] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.710786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.711080] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb78d5f2-49f0-49c4-b699-a11a7ed5283f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.711080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb78d5f2-49f0-49c4-b699-a11a7ed5283f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.711303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb78d5f2-49f0-49c4-b699-a11a7ed5283f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.711357] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb78d5f2-49f0-49c4-b699-a11a7ed5283f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.711424] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb78d5f2-49f0-49c4-b699-a11a7ed5283f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.826447] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.826447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.826447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.826447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.826447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.826447] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be created. [ 1190.847806] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.847982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.848101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.848386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.848566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.858612] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: UNINITIALIZED for 2s [ 1190.885772] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.886012] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.886150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.886422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.886525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.886624] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b is going to be updated. [ 1190.913736] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.913965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.914058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.914342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.914669] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.923585] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: IN_PROGRESS for 2s [ 1191.213312] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.213747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.216063] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb78d5f2-49f0-49c4-b699-a11a7ed5283f with status ACTIVE [ 1191.216195] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.216361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.216443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.216677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.216790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.216987] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.217149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.217662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.217662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.217662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.217810] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.217863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.217913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.218067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.218143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.218229] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb78d5f2-49f0-49c4-b699-a11a7ed5283f is going to be updated. [ 1191.239530] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.239703] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.239796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.240051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.240260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.240475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb78d5f2-49f0-49c4-b699-a11a7ed5283f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.469961] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1191.470194] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 deletion is rescheduled due to dependency. [ 1191.470257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.470420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.471030] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.471030] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.471204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.471204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.471362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.471460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.471564] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.974426] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.478150] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.570336] env[69656]: INFO networking_nsxv3.common.synchronization [req-8e3a04f0-9166-46d1-8fa6-456ea9b3953c req-b688a30c-e310-43e3-867d-f1bf3db10439 tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1192.570905] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1192.571287] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.571461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.571549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.571791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.571967] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.574244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.574448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.574531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.574629] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.574745] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.868255] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1192.868617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.868617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.869659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.869957] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.870169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.870283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.870473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.870703] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.870851] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.870963] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.935178] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: SUCCESS [ 1192.937377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.937377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.937377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.937377] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.937377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.937377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.937377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.937377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.937377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.937377] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.982026] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.982208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.982268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.982479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.982619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.982664] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1193.012178] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.012350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.012435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.012679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.012792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.020770] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1193.076876] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.373189] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.373408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.373486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.374135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.374413] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.374537] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.374596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.374822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.374901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.375039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.375339] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.375463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.375528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.375734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.375884] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.375975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.376045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.376189] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.376264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.376405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.376468] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.443829] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.444211] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.444211] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.444328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.444441] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.444540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.444602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.444748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.444835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.444923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.445094] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.445187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.445418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.445418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.445524] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.445611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.445672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.445817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.445892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.445973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.446072] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.579904] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.879910] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c40e462-de5f-44fc-812b-8caf1dff4c9e: rpc.has_security_group_logging(os_id): False [ 1193.901144] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.901356] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.901449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.901674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.901766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.901965] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.902086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.902150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.902304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.902381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.903054] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.903054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.903054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.903054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.903054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.903318] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.903318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.903318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.903427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.903920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.903920] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be created. [ 1193.909086] env[69656]: INFO networking_nsxv3.common.synchronization [req-d34a3718-2422-4e9f-a617-62de99dca572 req-696fb1ea-18b0-48ca-9ee9-5fe2a810d0e6 tempest-ServersWithFlavorSwapResizeTest-356263529 tempest-ServersWithFlavorSwapResizeTest-356263529-project-member] Enqueued Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGHEST for action security_group_members [ 1193.909615] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGHEST for action security_group_members [ 1193.909919] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-457b4cc0-32ad-4db2-819d-1a58cf1de954 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.910078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.910147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.910392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.910551] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.910651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.910711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.910854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.910937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.911043] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('457b4cc0-32ad-4db2-819d-1a58cf1de954',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.948104] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b: rpc.has_security_group_logging(os_id): False [ 1193.961300] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.961479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.961555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.962317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.962317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.970097] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.970448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.970448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.970744] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.970877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.971237] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.971564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.971564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.971699] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.971817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.972093] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.972251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.972351] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.972541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.972665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.973298] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.973525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.973667] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.973946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.973946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.974132] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b is going to be updated. [ 1193.978144] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1194.051669] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.051903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.051981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.052275] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.052430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.063935] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: IN_PROGRESS for 2s [ 1194.088664] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.089170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.089416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.090058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.090293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.090765] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1194.136564] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.136564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.136564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.136564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.136564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.153249] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1194.416053] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.416244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.416308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.416529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.416619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.416818] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.416913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.416977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.417150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.417228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.421019] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 is going to be updated. [ 1194.444192] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.444350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.444418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.444650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.444779] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.453666] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 in Status: IN_PROGRESS for 2s [ 1195.029707] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1195.030077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.030077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.030332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.030566] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.030701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.030789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.030993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.031100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.031212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.031337] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.535107] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.535107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.535107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.535107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.535107] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.535107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.535107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.535879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.535879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.535879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.535879] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.535879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.535879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.536324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.536324] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.536324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.536324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.536590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.536590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.536590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.536740] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.988443] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1195.988701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.039248] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3274dea2-eaf7-4169-ba91-1154eac58032: rpc.has_security_group_logging(os_id): False [ 1196.055681] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.055806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.055921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.056271] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.056404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.056682] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.056813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.056873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.057482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.057482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.057482] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.057482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.057482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.058071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.058071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.058071] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.058071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.058071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.058465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.058465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.058465] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1196.073562] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: SUCCESS [ 1196.073882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.118559] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.118797] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.118892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.119099] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.119287] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.131678] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1196.162054] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1196.163381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.356066] env[69656]: INFO networking_nsxv3.common.synchronization [None req-1e8f0f22-5a90-4411-9dc3-d81d84ddac89 tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGHEST for action security_group_rules [ 1196.356903] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGHEST for action security_group_rules [ 1196.357273] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38729b4b-23ae-4e26-b524-9c3d018d87eb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.357453] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.357557] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.357873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.357996] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38729b4b-23ae-4e26-b524-9c3d018d87eb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.431636] env[69656]: INFO networking_nsxv3.common.synchronization [None req-5a2a3d17-847f-4e74-a940-8eed405cfcba tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGHEST for action security_group_rules [ 1196.432162] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGHEST for action security_group_rules [ 1196.432467] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38729b4b-23ae-4e26-b524-9c3d018d87eb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.432571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.462759] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 in Status: SUCCESS [ 1196.462902] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 deletion is rescheduled due to dependency. [ 1196.463011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.877546] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.877704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.877778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.878058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.878207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.878263] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb already deleted. [ 1196.878336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.878484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.878672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.878736] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38729b4b-23ae-4e26-b524-9c3d018d87eb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.399286] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.399573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.399573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.399840] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.399943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.400055] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb already deleted. [ 1197.400136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.740479] env[69656]: INFO networking_nsxv3.common.synchronization [req-6d191e5d-0a91-42ed-a104-a9fbde707a1b req-71b6f527-3a0d-4c21-9c96-d52f0727e5aa tempest-ServerDiskConfigTestJSON-2110996415 tempest-ServerDiskConfigTestJSON-2110996415-project-member] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1197.740946] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1197.741315] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.741444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.741495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.741692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.741844] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.741957] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.741992] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.742144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.742231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.742323] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.122155] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-940 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.122383] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.122580] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.122892] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.123224] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.123416] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.123573] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.123805] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.123973] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.124219] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.124342] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.124487] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.124609] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.124731] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.124843] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.124997] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.145070] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.145264] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1198.145411] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.145696] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-940" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.146234] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-b7b5297e-ae99-4582-a1ea-0f9b75fbe22d taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.146474] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-b7b5297e-ae99-4582-a1ea-0f9b75fbe22d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.146685] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-b7b5297e-ae99-4582-a1ea-0f9b75fbe22d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.147134] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-b7b5297e-ae99-4582-a1ea-0f9b75fbe22d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.147315] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7b5297e-ae99-4582-a1ea-0f9b75fbe22d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.149169] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1198.149400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.245608] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.245864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.245864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.246083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.246175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.246378] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.246545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.246545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.246686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.246775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.246852] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 1198.276727] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.277668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.277668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.277668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.277668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.285905] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 1198.650627] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.650995] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.651065] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.651378] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.651611] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.651824] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port b7b5297e-ae99-4582-a1ea-0f9b75fbe22d not found, creating... [ 1198.652136] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.652312] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.652439] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.652677] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.652849] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.653154] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.653321] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.653445] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.653736] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.653894] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.654111] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: b7b5297e-ae99-4582-a1ea-0f9b75fbe22d is going to be created. [ 1198.676877] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.676877] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.677063] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.677323] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.677573] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.677814] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-b7b5297e-ae99-4582-a1ea-0f9b75fbe22d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.798970] env[69656]: INFO networking_nsxv3.common.synchronization [req-ef42e82d-91cf-4eac-afc4-c7c83dea7cb4 req-e79b87bd-e1d6-4474-ad74-79337a8a85b7 tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_members [ 1198.799526] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGHEST for action security_group_members [ 1198.800272] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.800398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.800467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.800665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.800814] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.800913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.800970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.801131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.801216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.801308] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.854640] env[69656]: INFO networking_nsxv3.common.synchronization [req-ef42e82d-91cf-4eac-afc4-c7c83dea7cb4 req-e79b87bd-e1d6-4474-ad74-79337a8a85b7 tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: f752fc17-1c5b-4074-913b-997feb0d19a6 with Priority: HIGHEST for action port [ 1198.855173] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f752fc17-1c5b-4074-913b-997feb0d19a6 with Priority: HIGHEST for action port [ 1198.855507] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-f752fc17-1c5b-4074-913b-997feb0d19a6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.855650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f752fc17-1c5b-4074-913b-997feb0d19a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.855720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f752fc17-1c5b-4074-913b-997feb0d19a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.855937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f752fc17-1c5b-4074-913b-997feb0d19a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.856026] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f752fc17-1c5b-4074-913b-997feb0d19a6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.306058] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.306058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.306058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.306058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.306058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.306058] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.306058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.306058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.306058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.306058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.306058] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b is going to be updated. [ 1199.328183] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.328639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.328947] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.329564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.331033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.337705] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: IN_PROGRESS for 2s [ 1199.358581] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f752fc17-1c5b-4074-913b-997feb0d19a6 with status ACTIVE [ 1199.362632] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.362632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.362632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.362632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.362632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.362632] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.362632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.362632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.362632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.362632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.362632] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.362632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.362632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.362632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.362632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.362632] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f752fc17-1c5b-4074-913b-997feb0d19a6 is going to be updated. [ 1199.380301] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.380468] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.380525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.380721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.380861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.381040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f752fc17-1c5b-4074-913b-997feb0d19a6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.468042] env[69656]: INFO networking_nsxv3.common.synchronization [req-cef8ccfb-51fb-4c3e-86ec-70dc5781bf32 req-3f0b4be1-4f8f-40f8-bfcc-37f914603245 tempest-ServerRescueNegativeTestJSON-70641521 tempest-ServerRescueNegativeTestJSON-70641521-project-member] Enqueued Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGHEST for action security_group_members [ 1199.468767] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGHEST for action security_group_members [ 1199.469251] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-841baacb-db1a-4155-8c56-e0d487b1795b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.469456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.469596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.469961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.470143] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.470296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.470399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.470641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.470793] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.470926] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841baacb-db1a-4155-8c56-e0d487b1795b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.883142] env[69656]: INFO networking_nsxv3.common.synchronization [req-6d191e5d-0a91-42ed-a104-a9fbde707a1b req-53417a55-770d-42cb-b327-0f0976b1d0e6 service nova] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_rules [ 1199.883377] env[69656]: INFO networking_nsxv3.common.synchronization [req-6d191e5d-0a91-42ed-a104-a9fbde707a1b req-53417a55-770d-42cb-b327-0f0976b1d0e6 service nova] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1199.883508] env[69656]: INFO networking_nsxv3.common.synchronization [req-6d191e5d-0a91-42ed-a104-a9fbde707a1b req-53417a55-770d-42cb-b327-0f0976b1d0e6 service nova] Enqueued Resource ID: b7b5297e-ae99-4582-a1ea-0f9b75fbe22d with Priority: HIGHEST for action port [ 1199.883757] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_rules [ 1199.883913] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1199.884019] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7b5297e-ae99-4582-a1ea-0f9b75fbe22d with Priority: HIGHEST for action port [ 1199.884692] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.884787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.884787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.884961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.885055] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.885843] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.885974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.886139] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7b5297e-ae99-4582-a1ea-0f9b75fbe22d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.886238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7b5297e-ae99-4582-a1ea-0f9b75fbe22d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.886299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7b5297e-ae99-4582-a1ea-0f9b75fbe22d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.886457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7b5297e-ae99-4582-a1ea-0f9b75fbe22d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.886531] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7b5297e-ae99-4582-a1ea-0f9b75fbe22d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.973845] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.974010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.974094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.974326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.994636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.994798] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.994937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.995025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.995335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.995335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.995417] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841baacb-db1a-4155-8c56-e0d487b1795b is going to be updated. [ 1200.020029] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.020029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.020029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.020280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.020280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.028323] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841baacb-db1a-4155-8c56-e0d487b1795b in Status: IN_PROGRESS for 2s [ 1200.295147] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 1200.295283] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b deletion is rescheduled due to dependency. [ 1200.295644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.295644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.295765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.295957] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.296113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.296113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.296252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.296335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.296443] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.388022] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.388158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.388708] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7b5297e-ae99-4582-a1ea-0f9b75fbe22d with status ACTIVE [ 1200.388896] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.389017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.389093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.389295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.389382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.389811] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.389811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.389811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.389981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.389981] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.390098] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.390192] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.390251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.390386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.390460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.390537] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7b5297e-ae99-4582-a1ea-0f9b75fbe22d is going to be updated. [ 1200.414072] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.414072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.414072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.414285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.414285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.415427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7b5297e-ae99-4582-a1ea-0f9b75fbe22d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.798395] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.301826] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.349238] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b in Status: SUCCESS [ 1201.349961] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b deletion is rescheduled due to dependency. [ 1201.349961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.806685] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.806846] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.806888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.807115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.807207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.807304] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 1201.835574] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.835728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.835770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.836123] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.836201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.843931] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 1202.037973] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841baacb-db1a-4155-8c56-e0d487b1795b in Status: SUCCESS [ 1202.038617] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841baacb-db1a-4155-8c56-e0d487b1795b deletion is rescheduled due to dependency. [ 1202.038617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.580866] env[69656]: INFO networking_nsxv3.common.synchronization [req-ebbf7d5c-606c-47e4-8f6e-719f2cfa6748 req-0cd8be3f-6c85-45cc-a79d-742f61ff24fc tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1202.581539] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1202.582350] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.582484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.582552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.582744] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.582899] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.583014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.583089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.583237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.583319] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.583433] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.086076] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.086277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.086399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.087050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.087050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.087050] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.087197] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.087197] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.087306] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.087385] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.087556] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be updated. [ 1203.119555] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.119784] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.119826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.120389] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.120582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.137705] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1203.856793] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 1203.856793] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.857234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.857234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.857312] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.857593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.857593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.857733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.857733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.857789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.857905] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.022842] env[69656]: INFO networking_nsxv3.common.synchronization [req-66de70d5-14f0-4a0c-a4c2-5cc7c040e1e4 req-afce5f4c-8a6d-4991-8f11-1af084645243 tempest-DeleteServersTestJSON-708906239 tempest-DeleteServersTestJSON-708906239-project-member] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1204.023433] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1204.023799] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.024266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.024266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.028949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.028949] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.028949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.028949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.028949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.028949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.029763] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.359818] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.360081] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.360173] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.360435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.360679] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.360853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.360937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.361139] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.361288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.361372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.361581] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.361754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.361754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.361887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.362148] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.362148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.362328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.362370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.362445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.362547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.362635] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.531543] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.531759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.531840] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.532168] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.532251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.532444] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.532544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.532610] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.532756] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.532830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.532915] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1204.559330] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.559478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.559529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.559744] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.559853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.567122] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1204.865361] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ceadc5a6-0e5a-4475-96ab-3f4a1cec315b: rpc.has_security_group_logging(os_id): False [ 1204.885318] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.885318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.885512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.885601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.885763] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.885971] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.886077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.886139] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.886302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.886379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.886753] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.886753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.886753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.887096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.887096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.887251] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.887342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.887404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.887541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.887663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.887749] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 1204.948766] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.949039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.949039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.949214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.949361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.967131] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 1205.148499] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1205.148682] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e deletion is rescheduled due to dependency. [ 1205.148857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.878022] env[69656]: INFO networking_nsxv3.common.synchronization [req-011cd596-40bd-4321-85bd-0c81545c76fb req-dbba3a15-0b7f-48ad-9bd1-cb8dd1f66866 tempest-AttachVolumeTestJSON-2030714394 tempest-AttachVolumeTestJSON-2030714394-project-member] Enqueued Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGHEST for action security_group_members [ 1205.878022] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGHEST for action security_group_members [ 1205.878022] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-9732c8f9-8304-4af7-9c52-c3d19cdecc90 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.878022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.878022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.878022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.878022] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.878022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.878022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.887028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.887028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.887028] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.074365] env[69656]: INFO networking_nsxv3.common.synchronization [req-06ab50a5-4766-4987-95d2-7a5f8bd73122 req-c8fdf5e1-fa63-451e-b4d4-d6ff8c6ca80b tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGHEST for action security_group_members [ 1206.074365] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGHEST for action security_group_members [ 1206.074365] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-38729b4b-23ae-4e26-b524-9c3d018d87eb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.074365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.074365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.074365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.074365] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.074365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.075122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.075403] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.075600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.076570] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38729b4b-23ae-4e26-b524-9c3d018d87eb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.333783] env[69656]: INFO networking_nsxv3.common.synchronization [req-adfc94f0-deb9-485a-8d22-ac3e92d99d5d req-f55d3b22-a794-42ca-ad52-4c4a4ede9469 tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGHEST for action security_group_members [ 1206.334364] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGHEST for action security_group_members [ 1206.335051] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-10987214-e215-44cd-98d2-5bd627e6c0e2 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.337175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.337175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.337175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.337175] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.337175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.337175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.337175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.337175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.337175] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10987214-e215-44cd-98d2-5bd627e6c0e2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.385680] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.385862] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.386090] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.386499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.386499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.386499] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.387096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.387096] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.387162] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.387216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.387312] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 is going to be updated. [ 1206.413911] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.414142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.414426] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.414684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.414684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.420836] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-565 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.421046] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.421177] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.421516] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.421795] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.421879] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.422045] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.422429] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.422584] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.422813] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1206.422913] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1206.423034] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1206.423143] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1206.423254] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1206.423361] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1206.423521] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1206.425174] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 in Status: IN_PROGRESS for 2s [ 1206.446691] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1206.447177] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1206.447330] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1206.447516] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.448596] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-e51c5348-838c-449a-ada6-444998bc88e8 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.448832] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-e51c5348-838c-449a-ada6-444998bc88e8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.448964] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-e51c5348-838c-449a-ada6-444998bc88e8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.449328] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-e51c5348-838c-449a-ada6-444998bc88e8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.449475] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e51c5348-838c-449a-ada6-444998bc88e8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.577166] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1206.577166] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 deletion is rescheduled due to dependency. [ 1206.577166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.580402] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.580588] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.580688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.580898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.581161] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.581264] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.581377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.581377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.581503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.581575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.581641] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb already deleted. [ 1206.581704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.839315] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.839315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.839315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.839315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.839315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.839708] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.839708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.839708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.839873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.839873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.839989] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 is going to be updated. [ 1206.866342] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.868175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.868175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.868175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.868175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.879905] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 in Status: IN_PROGRESS for 2s [ 1206.952586] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.952816] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.952950] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.953266] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.953423] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.953599] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port e51c5348-838c-449a-ada6-444998bc88e8 not found, creating... [ 1206.953886] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.954064] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.954188] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.954419] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.955031] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.955031] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.955031] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.955222] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.955338] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.955474] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.955616] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: e51c5348-838c-449a-ada6-444998bc88e8 is going to be created. [ 1206.977100] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.977100] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.977277] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.977502] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.978082] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.978082] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-e51c5348-838c-449a-ada6-444998bc88e8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.980377] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 1206.980567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.108587] env[69656]: INFO networking_nsxv3.common.synchronization [req-06ab50a5-4766-4987-95d2-7a5f8bd73122 req-701c7ebd-d998-44f9-8500-5310c9be1d43 service nova] Enqueued Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGHEST for action security_group_rules [ 1208.108804] env[69656]: INFO networking_nsxv3.common.synchronization [req-06ab50a5-4766-4987-95d2-7a5f8bd73122 req-701c7ebd-d998-44f9-8500-5310c9be1d43 service nova] Enqueued Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGHEST for action security_group_members [ 1208.108907] env[69656]: INFO networking_nsxv3.common.synchronization [req-06ab50a5-4766-4987-95d2-7a5f8bd73122 req-701c7ebd-d998-44f9-8500-5310c9be1d43 service nova] Enqueued Resource ID: e51c5348-838c-449a-ada6-444998bc88e8 with Priority: HIGHEST for action port [ 1208.109144] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGHEST for action security_group_rules [ 1208.109272] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGHEST for action security_group_members [ 1208.109368] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51c5348-838c-449a-ada6-444998bc88e8 with Priority: HIGHEST for action port [ 1208.109897] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38729b4b-23ae-4e26-b524-9c3d018d87eb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.110041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.110111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.110302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.110382] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38729b4b-23ae-4e26-b524-9c3d018d87eb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.111207] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-38729b4b-23ae-4e26-b524-9c3d018d87eb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.111318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.111377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.111559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.111712] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.111772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.111831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.111972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.112384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.112384] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38729b4b-23ae-4e26-b524-9c3d018d87eb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.113041] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e51c5348-838c-449a-ada6-444998bc88e8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.113160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e51c5348-838c-449a-ada6-444998bc88e8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.113214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e51c5348-838c-449a-ada6-444998bc88e8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.113342] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e51c5348-838c-449a-ada6-444998bc88e8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.116081] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e51c5348-838c-449a-ada6-444998bc88e8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.440747] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 in Status: SUCCESS [ 1208.441301] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 deletion is rescheduled due to dependency. [ 1208.441417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.615581] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-38729b4b-23ae-4e26-b524-9c3d018d87eb taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.615720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.615964] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38729b4b-23ae-4e26-b524-9c3d018d87eb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.616891] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e51c5348-838c-449a-ada6-444998bc88e8 with status ACTIVE [ 1208.617083] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.617214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.617288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.617583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.617681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.619608] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.619608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.619608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.619608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.619608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.619608] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.619608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.619608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.619608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.619608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.619608] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e51c5348-838c-449a-ada6-444998bc88e8 is going to be updated. [ 1208.638651] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.638809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.638902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.639099] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.639242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.639398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e51c5348-838c-449a-ada6-444998bc88e8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.890577] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 in Status: SUCCESS [ 1208.890853] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 deletion is rescheduled due to dependency. [ 1208.890853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.121616] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38729b4b-23ae-4e26-b524-9c3d018d87eb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.624914] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.625127] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.625205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.625737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.625737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.625737] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb is going to be created. [ 1209.648905] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.649121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.649245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.649488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.649853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.659524] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb in Status: UNINITIALIZED for 2s [ 1210.324203] env[69656]: INFO networking_nsxv3.common.synchronization [req-ed0144ce-de43-4dbb-9b11-87ef1f9d6a86 req-e65e006e-17cb-4346-9bf4-d50e859f534a tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1210.324203] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1210.324203] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.324203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.324203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.324203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.328212] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.328212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.328212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.328212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.328212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.328212] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.731801] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.732105] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.732428] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.732857] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.733298] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.733871] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.734175] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.734549] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.734809] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.735614] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1210.735964] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1210.736201] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1210.736511] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1210.736885] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1210.736962] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1210.737520] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1210.755920] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1210.759782] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1210.759782] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1210.759782] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.759782] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-cc928c6c-c043-4bca-ac51-a1cdf1b051b5 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.759782] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-cc928c6c-c043-4bca-ac51-a1cdf1b051b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.759782] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-cc928c6c-c043-4bca-ac51-a1cdf1b051b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.759782] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-cc928c6c-c043-4bca-ac51-a1cdf1b051b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.759782] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc928c6c-c043-4bca-ac51-a1cdf1b051b5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.830044] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.262203] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.262402] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.262531] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.262861] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.263036] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.263198] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port cc928c6c-c043-4bca-ac51-a1cdf1b051b5 not found, creating... [ 1211.263471] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.263661] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.263780] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.264066] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.264202] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.264491] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.264668] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.265092] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.265347] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.265579] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.265770] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: cc928c6c-c043-4bca-ac51-a1cdf1b051b5 is going to be created. [ 1211.286482] env[69656]: INFO networking_nsxv3.common.synchronization [req-c2eef34c-2ddb-4353-8646-621c42a26c4d req-6dadbc08-b828-44bd-9365-46abc99e4f2a tempest-ServerDiskConfigTestJSON-2110996415 tempest-ServerDiskConfigTestJSON-2110996415-project-member] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1211.286714] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGHEST for action security_group_members [ 1211.287285] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.289053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.289053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.289053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.289053] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.289053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.289053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.289053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.289053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.289053] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.289927] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.290380] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.290380] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.290452] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.291194] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.291194] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-cc928c6c-c043-4bca-ac51-a1cdf1b051b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.334239] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.669186] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb in Status: SUCCESS [ 1211.669325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.669517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.669765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.669989] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.670153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.670236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.670447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.670525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.670619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.670723] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38729b4b-23ae-4e26-b524-9c3d018d87eb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.793573] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.794105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.794105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.794105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.794105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.796020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.796020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.796020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.796020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.796020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.796020] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be updated. [ 1211.825039] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.825039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.825039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.825039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.825039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.833287] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: IN_PROGRESS for 2s [ 1211.838072] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.841818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.841818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.841818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.841818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.841818] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1211.865545] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.865692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.865771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.865979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.866163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.874075] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1212.173449] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38729b4b-23ae-4e26-b524-9c3d018d87eb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.284126] env[69656]: INFO networking_nsxv3.common.synchronization [req-ed0144ce-de43-4dbb-9b11-87ef1f9d6a86 req-91102c9e-e972-4181-b2f6-01fb55b208fe service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 1212.284457] env[69656]: INFO networking_nsxv3.common.synchronization [req-ed0144ce-de43-4dbb-9b11-87ef1f9d6a86 req-91102c9e-e972-4181-b2f6-01fb55b208fe service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1212.284457] env[69656]: INFO networking_nsxv3.common.synchronization [req-ed0144ce-de43-4dbb-9b11-87ef1f9d6a86 req-91102c9e-e972-4181-b2f6-01fb55b208fe service nova] Enqueued Resource ID: cc928c6c-c043-4bca-ac51-a1cdf1b051b5 with Priority: HIGHEST for action port [ 1212.284938] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 1212.284938] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1212.285090] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc928c6c-c043-4bca-ac51-a1cdf1b051b5 with Priority: HIGHEST for action port [ 1212.285449] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.285449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.285644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.285711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.285837] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.288902] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.288902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.289500] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc928c6c-c043-4bca-ac51-a1cdf1b051b5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.289500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc928c6c-c043-4bca-ac51-a1cdf1b051b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.289500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc928c6c-c043-4bca-ac51-a1cdf1b051b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.289727] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc928c6c-c043-4bca-ac51-a1cdf1b051b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.289727] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc928c6c-c043-4bca-ac51-a1cdf1b051b5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.675856] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38729b4b-23ae-4e26-b524-9c3d018d87eb: rpc.has_security_group_logging(os_id): False [ 1212.695527] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.695687] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.695775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.695977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.696070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.696313] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.700210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.700282] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.700477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.700559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.700664] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb is going to be created. [ 1212.766758] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.766919] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.766966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.767198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.767394] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.778962] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb in Status: IN_PROGRESS for 2s [ 1212.791472] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.791613] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.791901] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc928c6c-c043-4bca-ac51-a1cdf1b051b5 with status ACTIVE [ 1212.792154] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.792267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.792267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.792478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.792556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.792776] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.792877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.792877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.793020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.793095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.793281] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.793511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.793511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.793611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.793651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.793771] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc928c6c-c043-4bca-ac51-a1cdf1b051b5 is going to be updated. [ 1212.833588] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.833766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.833850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.834350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.834350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.834458] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc928c6c-c043-4bca-ac51-a1cdf1b051b5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.018634] env[69656]: INFO networking_nsxv3.common.synchronization [req-d549478d-78ec-4c36-8aa6-408285fb2973 req-744e3dbf-2a10-467c-bdab-10c6c771fcc9 tempest-ServerActionsTestOtherB-109014868 tempest-ServerActionsTestOtherB-109014868-project-member] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1213.019235] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1213.019539] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.019660] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.019728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.019927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.020200] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.020313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.020377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.020537] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.020624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.020717] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.523037] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.523037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.523037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.523210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.523210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.523612] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.523612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.523612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.523773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.523805] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.523872] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be updated. [ 1213.550292] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.550427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.550466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.550708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.550841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.560907] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: IN_PROGRESS for 2s [ 1213.652832] env[69656]: INFO networking_nsxv3.common.synchronization [req-97b153e2-ba94-4bc4-b31c-85a18abe4929 req-80d22ea5-ce59-4605-986c-3b95b3899d7f tempest-ServerRescueNegativeTestJSON-70641521 tempest-ServerRescueNegativeTestJSON-70641521-project-member] Enqueued Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_members [ 1213.653460] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_members [ 1213.653711] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.653843] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.653905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.654772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.654954] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.655093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.655093] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.655250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.655341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.656389] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.843893] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b in Status: SUCCESS [ 1213.843893] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b deletion is rescheduled due to dependency. [ 1213.844231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.883582] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1213.883865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.884040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.884247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.884434] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.884551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.884615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.885571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.885571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.885571] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.158055] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.279147] env[69656]: INFO networking_nsxv3.common.synchronization [None req-e854426d-f43d-4191-b162-438f288a454f tempest-AttachVolumeTestJSON-2030714394 tempest-AttachVolumeTestJSON-2030714394-project-member] Enqueued Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGHEST for action security_group_rules [ 1214.279147] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGHEST for action security_group_rules [ 1214.279147] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14e06840-25c7-4158-bab4-68425818e4d4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.279147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.279147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.279147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.279147] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14e06840-25c7-4158-bab4-68425818e4d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.386550] env[69656]: INFO networking_nsxv3.common.synchronization [None req-b3a2688c-295d-428a-a503-3334ba2b93f1 tempest-AttachVolumeTestJSON-2030714394 tempest-AttachVolumeTestJSON-2030714394-project-member] Enqueued Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGHEST for action security_group_rules [ 1214.386699] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.387492] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGHEST for action security_group_rules [ 1214.387840] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14e06840-25c7-4158-bab4-68425818e4d4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.387950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.660702] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.792988] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb in Status: SUCCESS [ 1214.793339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.798632] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.798769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.798832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.799057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.799148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.799575] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14e06840-25c7-4158-bab4-68425818e4d4 already deleted. [ 1214.799575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.799575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.799692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.799692] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14e06840-25c7-4158-bab4-68425818e4d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.888897] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.167044] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.167044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.167044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.167044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.167044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.167044] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a is going to be updated. [ 1215.219180] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.221891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.221891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.221891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.221891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.234933] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: IN_PROGRESS for 2s [ 1215.319314] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.319314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.319314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.319314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.319314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.319314] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14e06840-25c7-4158-bab4-68425818e4d4 already deleted. [ 1215.319314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.393629] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.393629] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.393629] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.393629] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.393629] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.393629] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1215.421922] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.422072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.422072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.422267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.422400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.431385] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1215.572945] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: SUCCESS [ 1215.572945] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 deletion is rescheduled due to dependency. [ 1215.572945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.500629] env[69656]: INFO networking_nsxv3.common.synchronization [None req-9b24df85-a526-4f3b-8b04-34337204e6c0 tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGHEST for action security_group_rules [ 1216.500629] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGHEST for action security_group_rules [ 1216.500629] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40050733-791a-4246-8deb-abb95731661b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.501140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.501140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.501915] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.501915] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40050733-791a-4246-8deb-abb95731661b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.589057] env[69656]: INFO networking_nsxv3.common.synchronization [None req-325d8d6d-1c9e-4e77-af97-f220d7416d77 tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGHEST for action security_group_rules [ 1216.589057] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGHEST for action security_group_rules [ 1216.589057] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40050733-791a-4246-8deb-abb95731661b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.589412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.022098] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.022260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.022330] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.022590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.022706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.022894] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40050733-791a-4246-8deb-abb95731661b already deleted. [ 1217.022894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.023087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.023203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.023281] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40050733-791a-4246-8deb-abb95731661b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.244619] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: SUCCESS [ 1217.246041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.441794] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1217.442029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.442307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.442639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.442846] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.443021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.443079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.443247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.443328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.443414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.443504] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.543219] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.544159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.544159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.544159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.544159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.544159] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40050733-791a-4246-8deb-abb95731661b already deleted. [ 1217.544159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.947273] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.947273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.947273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.947273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.947498] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.947498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.947498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.948247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.948247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.948247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.948247] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.948247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.948247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.948247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.948515] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.948515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.948515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.948638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.948666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.949219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.949219] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.451443] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06966f07-554f-446e-a2a7-17a62c52a519: rpc.has_security_group_logging(os_id): False [ 1218.469919] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.470227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.470306] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.470520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.470625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.470865] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.470973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.470973] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.471159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.471238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.471431] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.471526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.471586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.471747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.471823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.472820] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.473952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.474214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.474421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.474542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.474660] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1218.531818] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.532028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.532103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.532278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.532423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.574929] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1219.914898] env[69656]: INFO networking_nsxv3.common.synchronization [req-2b27d5fa-562d-492b-b813-bd9b94f40f09 req-18836b19-81f9-4cff-98f6-a46a2c514c90 tempest-DeleteServersTestJSON-708906239 tempest-DeleteServersTestJSON-708906239-project-member] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1219.915686] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1219.915945] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.916129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.916198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.916740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.916910] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.917028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.917094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.917248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.917336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.917430] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.184252] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.184474] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.184605] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.184876] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.185227] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.185401] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.185525] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.185752] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.185907] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.186196] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1220.186324] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1220.186438] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1220.186550] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1220.186667] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1220.186777] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1220.186913] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1220.207958] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1220.208126] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1220.208267] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1220.208440] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.208726] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-7842817c-106e-4625-9a69-d54cde82f416 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.208898] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-7842817c-106e-4625-9a69-d54cde82f416" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.209029] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-7842817c-106e-4625-9a69-d54cde82f416" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.209409] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-7842817c-106e-4625-9a69-d54cde82f416" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.209575] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7842817c-106e-4625-9a69-d54cde82f416',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.419608] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.419807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.419914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.420222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.420348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.420611] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.420736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.420802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.420986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.421091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.421186] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1220.448905] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.449121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.449121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.449310] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.449447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.457559] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1220.589248] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1220.589475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.712274] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.712525] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.712656] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.713029] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.713209] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.713374] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 7842817c-106e-4625-9a69-d54cde82f416 not found, creating... [ 1220.713646] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.713869] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.713996] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.714237] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.714380] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.714670] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.714844] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.715029] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.715189] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.715327] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.715475] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 7842817c-106e-4625-9a69-d54cde82f416 is going to be created. [ 1220.735389] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.735619] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.735715] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.735992] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.736246] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.736479] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-7842817c-106e-4625-9a69-d54cde82f416" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.442030] env[69656]: INFO networking_nsxv3.common.synchronization [req-2b27d5fa-562d-492b-b813-bd9b94f40f09 req-ce7a02cd-a4dc-42c1-a6f5-b91a2050cbfd service nova] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_rules [ 1221.442030] env[69656]: INFO networking_nsxv3.common.synchronization [req-2b27d5fa-562d-492b-b813-bd9b94f40f09 req-ce7a02cd-a4dc-42c1-a6f5-b91a2050cbfd service nova] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1221.442030] env[69656]: INFO networking_nsxv3.common.synchronization [req-2b27d5fa-562d-492b-b813-bd9b94f40f09 req-ce7a02cd-a4dc-42c1-a6f5-b91a2050cbfd service nova] Enqueued Resource ID: 7842817c-106e-4625-9a69-d54cde82f416 with Priority: HIGHEST for action port [ 1221.442030] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_rules [ 1221.442030] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1221.442030] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7842817c-106e-4625-9a69-d54cde82f416 with Priority: HIGHEST for action port [ 1221.444083] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.444083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.444083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.444083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.444083] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.444479] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.444479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.444550] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-7842817c-106e-4625-9a69-d54cde82f416 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.444669] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7842817c-106e-4625-9a69-d54cde82f416" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.444764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7842817c-106e-4625-9a69-d54cde82f416" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.444998] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7842817c-106e-4625-9a69-d54cde82f416" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.445103] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7842817c-106e-4625-9a69-d54cde82f416',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.947021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.947179] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.947366] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7842817c-106e-4625-9a69-d54cde82f416 with status ACTIVE [ 1221.947530] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.947881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.947881] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.948124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.948124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.948187] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.948254] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.948320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.948474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.948532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.948712] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.948798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.948836] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.948976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.949062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.949144] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7842817c-106e-4625-9a69-d54cde82f416 is going to be updated. [ 1221.969971] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.969971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.969971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.969971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.970199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.970278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7842817c-106e-4625-9a69-d54cde82f416" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.471046] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1222.471046] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 deletion is rescheduled due to dependency. [ 1222.471046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.471046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.471046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.471046] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.471046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.471046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.471046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.471046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.471046] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.974745] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.476188] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.733502] env[69656]: INFO networking_nsxv3.common.synchronization [req-6cda20e8-8d5c-4932-941f-da6752cde4bd req-648725ea-a141-47b2-8ad2-535803e73501 tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1223.733502] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1223.733502] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.733502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.733502] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.735032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.735032] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.735032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.735032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.735032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.735032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.735032] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.850941] env[69656]: INFO networking_nsxv3.common.synchronization [req-1f50ad0e-8261-4632-82f4-b206f053899f req-3245e012-384e-4f2b-80e9-cdc8d79abdbd tempest-ServerRescueNegativeTestJSON-70641521 tempest-ServerRescueNegativeTestJSON-70641521-project-member] Enqueued Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_members [ 1223.851458] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGHEST for action security_group_members [ 1223.851744] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.851885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.851950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.852160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.852373] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.852475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.852548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.852674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.852751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.852838] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.978901] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.979114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.979114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.979315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.979407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.979509] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1224.008524] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.008757] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.008757] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.008871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.009068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.016851] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1224.067276] env[69656]: INFO networking_nsxv3.common.synchronization [req-92882942-bd2c-425a-87e0-db02b55dfc8c req-2947e92e-f488-4e53-9744-a6d6f81325e5 tempest-AttachVolumeTestJSON-2030714394 tempest-AttachVolumeTestJSON-2030714394-project-member] Enqueued Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGHEST for action security_group_members [ 1224.067788] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGHEST for action security_group_members [ 1224.068101] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-14e06840-25c7-4158-bab4-68425818e4d4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.068222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.068286] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.068538] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.068892] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.068892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.068892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.069112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.069304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.069445] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14e06840-25c7-4158-bab4-68425818e4d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.239044] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.356026] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.356026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.356026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.356026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.356026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.356026] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.356026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.356026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.356026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.356026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.356507] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a is going to be updated. [ 1224.383311] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-150 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.383551] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-150" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.383702] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-150" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.384037] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-150" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.384302] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.384465] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.384584] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.384809] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.384970] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.385204] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.385320] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.385433] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.385543] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.385653] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.385762] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.385895] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.387815] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.387815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.387815] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.388016] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.388100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.397780] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: IN_PROGRESS for 2s [ 1224.418218] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.419030] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1224.419030] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.419030] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-150" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.419209] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-66c4c477-81f7-4a25-b7b0-7051ee7a9057 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.419296] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-66c4c477-81f7-4a25-b7b0-7051ee7a9057" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.419407] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-66c4c477-81f7-4a25-b7b0-7051ee7a9057" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.420057] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-66c4c477-81f7-4a25-b7b0-7051ee7a9057" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.420057] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66c4c477-81f7-4a25-b7b0-7051ee7a9057',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.571237] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.571571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.571571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.571638] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.571728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.571933] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.572039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.572100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.572249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.572323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.572406] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14e06840-25c7-4158-bab4-68425818e4d4 already deleted. [ 1224.572483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.742375] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.922045] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.922045] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.922266] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.922548] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.922628] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.922799] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 66c4c477-81f7-4a25-b7b0-7051ee7a9057 not found, creating... [ 1224.923076] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.923248] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.923372] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.923591] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.923732] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.924056] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.924221] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.924344] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.924553] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.924692] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.924860] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 66c4c477-81f7-4a25-b7b0-7051ee7a9057 is going to be created. [ 1224.942303] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.942530] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.942640] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.942907] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.943168] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.943394] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-66c4c477-81f7-4a25-b7b0-7051ee7a9057" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.245198] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.245440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.245555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.245870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.246036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.246199] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1225.273911] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.274127] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.274204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.274416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.274563] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.283223] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1225.632354] env[69656]: INFO networking_nsxv3.common.synchronization [req-92882942-bd2c-425a-87e0-db02b55dfc8c req-a1075576-4a50-4fb0-81cb-b6888d0059f9 service nova] Enqueued Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGHEST for action security_group_rules [ 1225.632354] env[69656]: INFO networking_nsxv3.common.synchronization [req-92882942-bd2c-425a-87e0-db02b55dfc8c req-a1075576-4a50-4fb0-81cb-b6888d0059f9 service nova] Enqueued Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGHEST for action security_group_members [ 1225.632354] env[69656]: INFO networking_nsxv3.common.synchronization [req-92882942-bd2c-425a-87e0-db02b55dfc8c req-a1075576-4a50-4fb0-81cb-b6888d0059f9 service nova] Enqueued Resource ID: 66c4c477-81f7-4a25-b7b0-7051ee7a9057 with Priority: HIGHEST for action port [ 1225.632354] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGHEST for action security_group_rules [ 1225.632354] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGHEST for action security_group_members [ 1225.632354] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66c4c477-81f7-4a25-b7b0-7051ee7a9057 with Priority: HIGHEST for action port [ 1225.632354] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14e06840-25c7-4158-bab4-68425818e4d4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.632354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.632354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.632354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.632354] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14e06840-25c7-4158-bab4-68425818e4d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.632354] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-14e06840-25c7-4158-bab4-68425818e4d4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.632354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.632354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.633214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.633214] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.633214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.633214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.633214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.633214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.633214] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14e06840-25c7-4158-bab4-68425818e4d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.633739] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-66c4c477-81f7-4a25-b7b0-7051ee7a9057 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.633860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66c4c477-81f7-4a25-b7b0-7051ee7a9057" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.633929] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66c4c477-81f7-4a25-b7b0-7051ee7a9057" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.634161] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66c4c477-81f7-4a25-b7b0-7051ee7a9057" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.634161] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66c4c477-81f7-4a25-b7b0-7051ee7a9057',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.026081] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1226.026459] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.026617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.026822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.027019] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.027132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.027198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.027347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.027424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.027506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.027594] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.136938] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14e06840-25c7-4158-bab4-68425818e4d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.137538] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-14e06840-25c7-4158-bab4-68425818e4d4 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.137653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.137804] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66c4c477-81f7-4a25-b7b0-7051ee7a9057 with status ACTIVE [ 1226.137957] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.138078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.138182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.138357] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.138442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.138618] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.138711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.138771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.138921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.139010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.139278] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.139392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.139475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.139583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.139662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.139760] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66c4c477-81f7-4a25-b7b0-7051ee7a9057 is going to be updated. [ 1226.175543] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.175725] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.175725] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.175914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.176069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.176222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66c4c477-81f7-4a25-b7b0-7051ee7a9057" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.303728] env[69656]: INFO networking_nsxv3.common.synchronization [req-e8841585-6310-4e79-8867-a490ba4010d4 req-b11e3108-8d86-41dd-9791-809233c8748d tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGHEST for action security_group_members [ 1226.304276] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGHEST for action security_group_members [ 1226.304629] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-40050733-791a-4246-8deb-abb95731661b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.304794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.304908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.305198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.305406] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.305544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.306083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.306083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.306083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.306083] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40050733-791a-4246-8deb-abb95731661b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.408832] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a in Status: SUCCESS [ 1226.408832] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a deletion is rescheduled due to dependency. [ 1226.408832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.534407] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.534407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.534407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.534407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.534407] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.534407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.534407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.534407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.534407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.534407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.534407] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.534407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.534407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.534407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.534407] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.534407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.535196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.535196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.535196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.535196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.535196] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.642515] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14e06840-25c7-4158-bab4-68425818e4d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.654041] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.654041] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.654041] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.654430] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.654728] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.654964] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.655156] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.655420] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.655619] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.655878] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.656045] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1226.656205] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1226.656345] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1226.656495] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.656636] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1226.656801] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1226.675102] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1226.675315] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1226.675471] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1226.675660] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.676041] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-17f75302-9ea7-4fc3-ad4d-57727f35b38c taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.676256] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-17f75302-9ea7-4fc3-ad4d-57727f35b38c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.676378] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-17f75302-9ea7-4fc3-ad4d-57727f35b38c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.676704] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-17f75302-9ea7-4fc3-ad4d-57727f35b38c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.676843] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17f75302-9ea7-4fc3-ad4d-57727f35b38c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.808179] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.808312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.808357] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.808561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.808648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.808840] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.808937] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.809025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.809534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.809619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.809708] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40050733-791a-4246-8deb-abb95731661b already deleted. [ 1226.809789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.038815] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3274dea2-eaf7-4169-ba91-1154eac58032: rpc.has_security_group_logging(os_id): False [ 1227.055900] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.056112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.056214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.056440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.056533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.056759] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.056867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.056921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.057086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.057166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.057356] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.057466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.057521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.057641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.057706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.057877] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.058015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.058074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.058177] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.058276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.058332] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1227.117301] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.117445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.117518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.117719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.117858] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.131117] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1227.144052] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.144052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.144052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.144313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.144352] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.144471] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14e06840-25c7-4158-bab4-68425818e4d4 is going to be created. [ 1227.163932] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.164089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.164165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.164376] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.164528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.173876] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14e06840-25c7-4158-bab4-68425818e4d4 in Status: UNINITIALIZED for 2s [ 1227.181034] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.181203] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.181203] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.181467] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.181621] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.181777] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 17f75302-9ea7-4fc3-ad4d-57727f35b38c not found, creating... [ 1227.182081] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.182255] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.182375] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.182598] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.182743] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.183034] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.183200] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.183365] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.183533] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.183673] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.183846] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 17f75302-9ea7-4fc3-ad4d-57727f35b38c is going to be created. [ 1227.216211] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.216451] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.216580] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.216842] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.217100] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.217328] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-17f75302-9ea7-4fc3-ad4d-57727f35b38c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.295662] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1227.295946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.892761] env[69656]: INFO networking_nsxv3.common.synchronization [req-e8841585-6310-4e79-8867-a490ba4010d4 req-d3e6353b-23f9-4226-bfbd-015ee521daff service nova] Enqueued Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGHEST for action security_group_rules [ 1227.892761] env[69656]: INFO networking_nsxv3.common.synchronization [req-e8841585-6310-4e79-8867-a490ba4010d4 req-d3e6353b-23f9-4226-bfbd-015ee521daff service nova] Enqueued Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGHEST for action security_group_members [ 1227.892761] env[69656]: INFO networking_nsxv3.common.synchronization [req-e8841585-6310-4e79-8867-a490ba4010d4 req-d3e6353b-23f9-4226-bfbd-015ee521daff service nova] Enqueued Resource ID: 17f75302-9ea7-4fc3-ad4d-57727f35b38c with Priority: HIGHEST for action port [ 1227.892761] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGHEST for action security_group_rules [ 1227.892761] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGHEST for action security_group_members [ 1227.892761] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f75302-9ea7-4fc3-ad4d-57727f35b38c with Priority: HIGHEST for action port [ 1227.893652] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40050733-791a-4246-8deb-abb95731661b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.893938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.894238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.894546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.894750] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40050733-791a-4246-8deb-abb95731661b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.896356] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-40050733-791a-4246-8deb-abb95731661b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.896539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.896598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.896807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.896994] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.897150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.897243] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.897417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.897535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.897653] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40050733-791a-4246-8deb-abb95731661b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.898522] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-17f75302-9ea7-4fc3-ad4d-57727f35b38c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.898618] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17f75302-9ea7-4fc3-ad4d-57727f35b38c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.898710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17f75302-9ea7-4fc3-ad4d-57727f35b38c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.898878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17f75302-9ea7-4fc3-ad4d-57727f35b38c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.898994] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17f75302-9ea7-4fc3-ad4d-57727f35b38c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.401370] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-40050733-791a-4246-8deb-abb95731661b taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.401370] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.401370] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40050733-791a-4246-8deb-abb95731661b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.401601] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17f75302-9ea7-4fc3-ad4d-57727f35b38c with status ACTIVE [ 1228.401797] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.401908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.401976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.402192] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.402279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.402446] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.402541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.402602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.402745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.402818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.402992] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.403318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.403408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.403577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.403679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.403786] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17f75302-9ea7-4fc3-ad4d-57727f35b38c is going to be updated. [ 1228.424217] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.424217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.424217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.424457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.424457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.424570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17f75302-9ea7-4fc3-ad4d-57727f35b38c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.661572] env[69656]: INFO networking_nsxv3.common.synchronization [req-e34503bf-03a7-45a7-84b8-05d524464d40 req-9916b4aa-276c-422a-8a9f-f61fccbd84ca tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_members [ 1228.662213] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_members [ 1228.662323] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3521005-0bf3-4791-8930-fe6bb6c94423 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.662450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.662521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.662712] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.662909] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.662970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.663055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.663210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.663295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.663386] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.906347] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40050733-791a-4246-8deb-abb95731661b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.936511] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.936717] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.936847] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.937139] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.937399] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.937555] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.937674] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.937889] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.938529] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.938529] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1228.938529] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1228.938529] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1228.938730] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1228.938730] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1228.938798] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1228.938924] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1228.957407] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1228.957574] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1228.957717] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1228.957896] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-208" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.958231] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-22fbe3de-37da-419e-b3da-5df8fc2751e5 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.958404] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-22fbe3de-37da-419e-b3da-5df8fc2751e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.958530] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-22fbe3de-37da-419e-b3da-5df8fc2751e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.958846] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-22fbe3de-37da-419e-b3da-5df8fc2751e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.959134] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22fbe3de-37da-419e-b3da-5df8fc2751e5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.146736] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1229.148029] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.165602] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.185065] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14e06840-25c7-4158-bab4-68425818e4d4 in Status: SUCCESS [ 1229.185328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.186144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.186144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.186348] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.186495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.186565] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.186770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.186877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.186979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.187110] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14e06840-25c7-4158-bab4-68425818e4d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.408959] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.409158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.409423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.409505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.409653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.409805] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40050733-791a-4246-8deb-abb95731661b is going to be created. [ 1229.433146] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.433295] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.433332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.433530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.433694] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.441617] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40050733-791a-4246-8deb-abb95731661b in Status: UNINITIALIZED for 2s [ 1229.461159] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.461823] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.461823] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.462024] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.462248] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.462412] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 22fbe3de-37da-419e-b3da-5df8fc2751e5 not found, creating... [ 1229.462905] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.462905] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.463181] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.463215] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.463347] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.463634] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.463794] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.464074] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.464365] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.464467] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.464721] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 22fbe3de-37da-419e-b3da-5df8fc2751e5 is going to be created. [ 1229.482503] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.482696] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.482819] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.483102] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.483334] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.483542] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-22fbe3de-37da-419e-b3da-5df8fc2751e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.667550] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.689254] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14e06840-25c7-4158-bab4-68425818e4d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.170106] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.170387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.170387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.170562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.170650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.170752] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3521005-0bf3-4791-8930-fe6bb6c94423 is going to be updated. [ 1230.191536] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14e06840-25c7-4158-bab4-68425818e4d4: rpc.has_security_group_logging(os_id): False [ 1230.214647] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.214824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.214868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.215129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.215281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.222732] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.222862] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.222932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.223166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.223254] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.223488] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.223586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.223647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.223829] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.223918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.224776] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14e06840-25c7-4158-bab4-68425818e4d4 is going to be created. [ 1230.226856] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: IN_PROGRESS for 2s [ 1230.284880] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.285106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.285167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.285411] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.285592] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.291617] env[69656]: INFO networking_nsxv3.common.synchronization [req-e34503bf-03a7-45a7-84b8-05d524464d40 req-12494e3d-b443-40c6-a42e-fddc67f933a3 service nova] Enqueued Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_rules [ 1230.291794] env[69656]: INFO networking_nsxv3.common.synchronization [req-e34503bf-03a7-45a7-84b8-05d524464d40 req-12494e3d-b443-40c6-a42e-fddc67f933a3 service nova] Enqueued Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_members [ 1230.291934] env[69656]: INFO networking_nsxv3.common.synchronization [req-e34503bf-03a7-45a7-84b8-05d524464d40 req-12494e3d-b443-40c6-a42e-fddc67f933a3 service nova] Enqueued Resource ID: 22fbe3de-37da-419e-b3da-5df8fc2751e5 with Priority: HIGHEST for action port [ 1230.292181] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_rules [ 1230.292324] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_members [ 1230.296020] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22fbe3de-37da-419e-b3da-5df8fc2751e5 with Priority: HIGHEST for action port [ 1230.296020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3521005-0bf3-4791-8930-fe6bb6c94423 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.296020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.296020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.296020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.296020] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.296020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3521005-0bf3-4791-8930-fe6bb6c94423 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.296020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.296020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-22fbe3de-37da-419e-b3da-5df8fc2751e5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.296020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22fbe3de-37da-419e-b3da-5df8fc2751e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.296020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22fbe3de-37da-419e-b3da-5df8fc2751e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.296020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22fbe3de-37da-419e-b3da-5df8fc2751e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.296020] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22fbe3de-37da-419e-b3da-5df8fc2751e5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.297097] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14e06840-25c7-4158-bab4-68425818e4d4 in Status: IN_PROGRESS for 2s [ 1230.440450] env[69656]: INFO networking_nsxv3.common.synchronization [req-9111d7bf-a9ce-4c24-9fde-07ca128f3b8b req-acbf781d-a154-439c-a405-4cd03def2ef7 tempest-ServersTestManualDisk-1181081679 tempest-ServersTestManualDisk-1181081679-project-member] Enqueued Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGHEST for action security_group_members [ 1230.441026] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGHEST for action security_group_members [ 1230.441340] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc5eb60b-e0f7-414b-a660-add25da9efa7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.441461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.441525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.441727] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.441891] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.441997] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.442067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.442217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.442304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.442389] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc5eb60b-e0f7-414b-a660-add25da9efa7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.802174] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3521005-0bf3-4791-8930-fe6bb6c94423 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.802174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.802174] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22fbe3de-37da-419e-b3da-5df8fc2751e5 with status ACTIVE [ 1230.802174] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.802174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.802174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.802174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.802174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.802174] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.802174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.802174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.802174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.802174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.802174] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.802871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.802871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.802871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.802871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.802871] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22fbe3de-37da-419e-b3da-5df8fc2751e5 is going to be updated. [ 1230.823094] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.823094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.823094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.823094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.823094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.823094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22fbe3de-37da-419e-b3da-5df8fc2751e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.944791] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.945114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.945199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.945340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.945429] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.945627] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.945722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.945776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.945928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.946732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.946732] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 is going to be updated. [ 1230.975996] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.976172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.976263] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.976422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.976554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.985231] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 in Status: IN_PROGRESS for 2s [ 1231.451383] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40050733-791a-4246-8deb-abb95731661b in Status: SUCCESS [ 1231.451673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.451929] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.452283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.452283] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.452529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.452529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.452631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.452717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.452936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.452936] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40050733-791a-4246-8deb-abb95731661b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.955425] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40050733-791a-4246-8deb-abb95731661b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.237401] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: SUCCESS [ 1232.237620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.237790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.238046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.238247] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.238422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.238600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.238746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.238845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.238907] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.309494] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14e06840-25c7-4158-bab4-68425818e4d4 in Status: SUCCESS [ 1232.309715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.457411] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40050733-791a-4246-8deb-abb95731661b: rpc.has_security_group_logging(os_id): False [ 1232.475045] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.475045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.475203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.475308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.475406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.475743] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.475743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.476076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.476076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.476076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.476368] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40050733-791a-4246-8deb-abb95731661b is going to be created. [ 1232.529246] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.529385] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.529385] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.529619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.529809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.538822] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40050733-791a-4246-8deb-abb95731661b in Status: IN_PROGRESS for 2s [ 1232.741080] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.995113] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 in Status: SUCCESS [ 1232.995323] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 deletion is rescheduled due to dependency. [ 1232.995443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.245382] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.347515] env[69656]: INFO networking_nsxv3.common.synchronization [req-89ee3b19-d9c9-40e5-be3e-122bce954e3c req-19c93b13-bb43-446e-b29f-df9adb374ed7 tempest-ServerActionsTestOtherB-109014868 tempest-ServerActionsTestOtherB-109014868-project-member] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1233.348471] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1233.348471] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.348628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.348628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.348762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.349657] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.349773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.349840] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.350349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.350349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.350349] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.747941] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.748277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.748277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.748571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.748571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.748728] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3521005-0bf3-4791-8930-fe6bb6c94423 is going to be updated. [ 1233.777125] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.777294] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.777356] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.777552] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.777697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.792544] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: IN_PROGRESS for 2s [ 1233.855325] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.855325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.855325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.855325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.855325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.855325] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.855325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.855325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.855325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.855325] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.855325] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be updated. [ 1233.878090] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.878090] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.878090] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.878952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.878952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.886634] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: IN_PROGRESS for 2s [ 1234.394811] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.395070] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.395212] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.395457] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.395858] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.395858] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.396048] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.397132] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.397353] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.398311] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.398311] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.398311] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.398311] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.398311] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.398311] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.398311] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1234.417551] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1234.417731] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1234.417860] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1234.418445] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.418445] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-14e87a40-e384-4433-9219-2d25376a7a37 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.418644] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.418644] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.418981] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.419141] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e87a40-e384-4433-9219-2d25376a7a37',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.550651] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40050733-791a-4246-8deb-abb95731661b in Status: SUCCESS [ 1234.550909] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.850309] env[69656]: INFO networking_nsxv3.common.synchronization [req-db208a76-48a5-4161-bdae-5c06c8c9d759 req-10111e5a-781b-42e7-a517-ad1091272a09 tempest-DeleteServersTestJSON-708906239 tempest-DeleteServersTestJSON-708906239-project-member] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1234.850309] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1234.850309] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.850309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.850309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.850309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.850309] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.850309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.850309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.850309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.850309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.850309] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.921410] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.921647] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.921778] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.922129] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.922302] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.922465] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 14e87a40-e384-4433-9219-2d25376a7a37 not found, creating... [ 1234.922733] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.922896] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.923034] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.923272] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.923442] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.923741] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.923941] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.924086] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.924302] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.924443] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.924586] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 14e87a40-e384-4433-9219-2d25376a7a37 is going to be created. [ 1234.945169] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.945399] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.945518] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.945788] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.946038] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.946307] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.354537] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.354730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.354852] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.356041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.356041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.356041] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.356041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.356041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.356041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.356041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.356041] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1235.381974] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.382112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.382191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.382523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.382731] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.393053] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1235.698423] env[69656]: INFO networking_nsxv3.common.synchronization [req-89ee3b19-d9c9-40e5-be3e-122bce954e3c req-7214fa21-6839-4454-8977-b31e2fa7090b service nova] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_rules [ 1235.698576] env[69656]: INFO networking_nsxv3.common.synchronization [req-89ee3b19-d9c9-40e5-be3e-122bce954e3c req-7214fa21-6839-4454-8977-b31e2fa7090b service nova] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1235.698725] env[69656]: INFO networking_nsxv3.common.synchronization [req-89ee3b19-d9c9-40e5-be3e-122bce954e3c req-7214fa21-6839-4454-8977-b31e2fa7090b service nova] Enqueued Resource ID: 14e87a40-e384-4433-9219-2d25376a7a37 with Priority: HIGHEST for action port [ 1235.698975] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_rules [ 1235.699118] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1235.699214] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e87a40-e384-4433-9219-2d25376a7a37 with Priority: HIGHEST for action port [ 1235.699750] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.699870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.699940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.704280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.704408] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.705337] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.705444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.705622] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-14e87a40-e384-4433-9219-2d25376a7a37 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.705719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.705787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.705948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.706041] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e87a40-e384-4433-9219-2d25376a7a37',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.803855] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: SUCCESS [ 1235.804238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.804312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.804526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.804709] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.804824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.804885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.805092] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.805162] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.805246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.805333] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.896086] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: SUCCESS [ 1235.896353] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 deletion is rescheduled due to dependency. [ 1235.897233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.897744] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.898361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.898589] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.899690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.899690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.899690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.899690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.899866] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.208129] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.208278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.208481] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14e87a40-e384-4433-9219-2d25376a7a37 with status ACTIVE [ 1236.208646] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.208753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.208818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.209052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.209145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.209326] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.209421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.209481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.209631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.209704] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.209884] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.209975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.210133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.210297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.210373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.210857] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14e87a40-e384-4433-9219-2d25376a7a37 is going to be updated. [ 1236.229619] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.229781] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.229870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.230102] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.230265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.230434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.308793] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.406796] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.810357] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3521005-0bf3-4791-8930-fe6bb6c94423: rpc.has_security_group_logging(os_id): False [ 1236.844863] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.845035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.847467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.847467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.868247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.868370] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.868438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.868489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.868690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.868773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.868866] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3521005-0bf3-4791-8930-fe6bb6c94423 is going to be updated. [ 1236.909698] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.933599] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.933745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.933804] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.934063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.934213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.954411] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: IN_PROGRESS for 2s [ 1237.402046] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1237.402529] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 deletion is rescheduled due to dependency. [ 1237.402529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.412450] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.412691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.412691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.412864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.412953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.413064] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be updated. [ 1237.441026] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.441026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.441026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.441026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.441026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.449544] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: IN_PROGRESS for 2s [ 1238.115071] env[69656]: INFO networking_nsxv3.common.synchronization [req-9cd9e927-f034-4508-b6a3-98428b5d91c3 req-0c2342ef-b15f-4803-8d65-0681f0427d77 tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1238.115071] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1238.115071] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.115071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.115071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.115071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.115071] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.116299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.116415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.116642] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.116780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.116901] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.452039] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.452039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.452039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.452039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.452039] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.452039] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.452498] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.452820] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.453460] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.453787] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1238.453995] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1238.454207] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1238.454389] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1238.455590] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1238.455590] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1238.455590] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1238.471878] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1238.472129] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1238.472369] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1238.472639] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-581" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.476360] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-4d0c9ee9-22c0-4ed4-b889-219b6faff31f taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.476360] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-4d0c9ee9-22c0-4ed4-b889-219b6faff31f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.476360] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-4d0c9ee9-22c0-4ed4-b889-219b6faff31f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.476360] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-4d0c9ee9-22c0-4ed4-b889-219b6faff31f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.476360] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d0c9ee9-22c0-4ed4-b889-219b6faff31f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.622775] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.966577] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: SUCCESS [ 1238.966577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.979319] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.979319] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.979319] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.979319] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.979319] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.979319] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 4d0c9ee9-22c0-4ed4-b889-219b6faff31f not found, creating... [ 1238.979319] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.979319] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.979319] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.979319] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.979319] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.979693] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.979693] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.979693] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.979693] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.980439] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.980890] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 4d0c9ee9-22c0-4ed4-b889-219b6faff31f is going to be created. [ 1239.004175] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.004175] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.004175] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.004175] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.004175] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.004175] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-4d0c9ee9-22c0-4ed4-b889-219b6faff31f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.126652] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.458676] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: SUCCESS [ 1239.458905] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.459079] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.459285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.459566] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.459566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.459681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.459778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.459854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.459935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.460035] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.629078] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.631486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.631486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.631486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.631486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.631486] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1239.655392] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.655795] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.655795] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.655997] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.655997] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.667704] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1239.943553] env[69656]: INFO networking_nsxv3.common.synchronization [req-9cd9e927-f034-4508-b6a3-98428b5d91c3 req-550661b9-6ac9-4fb3-8cde-ce84c1ed276c service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 1239.943793] env[69656]: INFO networking_nsxv3.common.synchronization [req-9cd9e927-f034-4508-b6a3-98428b5d91c3 req-550661b9-6ac9-4fb3-8cde-ce84c1ed276c service nova] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1239.943947] env[69656]: INFO networking_nsxv3.common.synchronization [req-9cd9e927-f034-4508-b6a3-98428b5d91c3 req-550661b9-6ac9-4fb3-8cde-ce84c1ed276c service nova] Enqueued Resource ID: 4d0c9ee9-22c0-4ed4-b889-219b6faff31f with Priority: HIGHEST for action port [ 1239.944743] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_rules [ 1239.944800] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1239.944915] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d0c9ee9-22c0-4ed4-b889-219b6faff31f with Priority: HIGHEST for action port [ 1239.945269] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.945396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.945462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.945662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.945742] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.946669] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.946770] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.946966] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d0c9ee9-22c0-4ed4-b889-219b6faff31f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.947127] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d0c9ee9-22c0-4ed4-b889-219b6faff31f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.947127] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d0c9ee9-22c0-4ed4-b889-219b6faff31f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.947299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d0c9ee9-22c0-4ed4-b889-219b6faff31f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.947370] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d0c9ee9-22c0-4ed4-b889-219b6faff31f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.962482] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.059673] env[69656]: INFO networking_nsxv3.common.synchronization [None req-e01817c7-97a6-4954-99bf-3d3d228476f7 None None] Enqueued Resource ID: cbe8f753-42dc-4de6-a063-6843cac17aa1 with Priority: HIGHEST for action port [ 1240.059938] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe8f753-42dc-4de6-a063-6843cac17aa1 with Priority: HIGHEST for action port [ 1240.060531] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbe8f753-42dc-4de6-a063-6843cac17aa1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.060653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbe8f753-42dc-4de6-a063-6843cac17aa1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.060721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbe8f753-42dc-4de6-a063-6843cac17aa1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.060976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbe8f753-42dc-4de6-a063-6843cac17aa1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.065450] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbe8f753-42dc-4de6-a063-6843cac17aa1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.449878] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.450152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.451449] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d0c9ee9-22c0-4ed4-b889-219b6faff31f with status ACTIVE [ 1240.451636] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.451753] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.451819] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.452044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.452140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.452349] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.452397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.452454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.452616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.452691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.452869] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.452960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.453035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.453179] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.453251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.453333] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d0c9ee9-22c0-4ed4-b889-219b6faff31f is going to be updated. [ 1240.464315] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ed397b9-8a6a-442e-a200-45439f9f86d9: rpc.has_security_group_logging(os_id): False [ 1240.490385] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.490586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.490656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.491040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.491040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.491206] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.491306] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.491365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.491505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.491578] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.491667] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be updated. [ 1240.495032] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.495163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.495229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.495367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.495490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.495641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d0c9ee9-22c0-4ed4-b889-219b6faff31f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.553458] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.553612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.553671] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.553880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.554085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.567603] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: IN_PROGRESS for 2s [ 1240.567808] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbe8f753-42dc-4de6-a063-6843cac17aa1 [ 1240.568012] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.568148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.568202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.568404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.568490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.568590] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbe8f753-42dc-4de6-a063-6843cac17aa1 already deleted. [ 1240.568675] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbe8f753-42dc-4de6-a063-6843cac17aa1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.261491] env[69656]: INFO networking_nsxv3.common.synchronization [None req-df6cb89c-592d-4f93-a540-13173f51a78c tempest-ServerActionsTestJSON-1918891154 tempest-ServerActionsTestJSON-1918891154-project-member] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_rules [ 1241.261491] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_rules [ 1241.261491] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.261491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.261491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.261491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.261714] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.351323] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f2969226-2fbe-474a-bb99-a899d634699d tempest-ServerActionsTestJSON-1918891154 tempest-ServerActionsTestJSON-1918891154-project-member] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_rules [ 1241.351906] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_rules [ 1241.352224] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.352329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.675827] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1241.676209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.676209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.676378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.676569] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.676684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.676750] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.676906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.676989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.677095] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.780333] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.780541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.780668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.780945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.781089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.781235] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 already deleted. [ 1241.781361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.781548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.781759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.781883] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.179641] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.197070] env[69656]: INFO networking_nsxv3.common.synchronization [None req-2faa92c8-6a8b-4a59-8de8-5dcbf1904bfd None None] Enqueued Resource ID: b687a975-32dc-4401-b955-387a25c86189 with Priority: HIGHEST for action port [ 1242.197329] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b687a975-32dc-4401-b955-387a25c86189 with Priority: HIGHEST for action port [ 1242.197871] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-b687a975-32dc-4401-b955-387a25c86189 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.197998] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b687a975-32dc-4401-b955-387a25c86189" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.198078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b687a975-32dc-4401-b955-387a25c86189" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.198340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b687a975-32dc-4401-b955-387a25c86189" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.198422] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b687a975-32dc-4401-b955-387a25c86189',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.302088] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.302088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.302088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.302088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.302088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.302088] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 already deleted. [ 1242.302088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.582609] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: SUCCESS [ 1242.582775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.684385] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.702231] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b687a975-32dc-4401-b955-387a25c86189 [ 1242.702231] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.702231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.702231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.702231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.702231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.702231] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b687a975-32dc-4401-b955-387a25c86189 already deleted. [ 1242.702231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b687a975-32dc-4401-b955-387a25c86189" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.900761] env[69656]: INFO networking_nsxv3.common.synchronization [req-91b1152d-b6ff-4133-93ee-f13872d2bcb5 req-6796c1b3-be81-4401-bdbb-2bd3d75d33a7 tempest-AttachVolumeShelveTestJSON-958915703 tempest-AttachVolumeShelveTestJSON-958915703-project-member] Enqueued Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_members [ 1242.901374] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGHEST for action security_group_members [ 1242.901677] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.901798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.901868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.902131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.902293] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.902395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.902453] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.902604] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.902690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.902783] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.188623] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.188828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.188896] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.189135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.189336] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.189336] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1243.233254] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.234399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.234399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.234399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.234399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.245598] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1243.404657] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.404896] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.404896] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.405473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.405473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.405654] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.405754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.405818] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.405991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.406082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.406172] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 is going to be updated. [ 1243.431389] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.431617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.431700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.432118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.432359] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.440677] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 in Status: IN_PROGRESS for 2s [ 1245.256159] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1245.256503] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.256542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.256746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.256939] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.257075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.257143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.257301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.257384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.257870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.257870] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.451899] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 in Status: SUCCESS [ 1245.452110] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 deletion is rescheduled due to dependency. [ 1245.452248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.759974] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.760180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.760305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.760564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.760734] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.760829] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.760892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.761062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.761151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.761240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.761389] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.761480] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.761544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.761684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.761818] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.761915] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.761987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.762161] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.762242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.762332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.762437] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.783535] env[69656]: INFO networking_nsxv3.common.synchronization [req-38f087bd-662c-47aa-bd1b-eb9b1952bc56 req-7f84f68d-c2b3-480d-b5ed-778583a10045 tempest-DeleteServersTestJSON-708906239 tempest-DeleteServersTestJSON-708906239-project-member] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1245.784126] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1245.784357] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.784500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.784577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.784721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.784863] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.784963] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.788665] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.788927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.789043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.789134] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.072126] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.072457] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.072642] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.072990] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.073325] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.073530] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.073663] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.073945] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.074181] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.074419] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1246.074556] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.074695] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.074817] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.074944] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1246.075100] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.075276] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.093105] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.093386] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1246.093504] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.093695] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-404" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.094118] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-0a11a182-3e5b-420e-a4db-5bbe224198ed taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.094329] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-0a11a182-3e5b-420e-a4db-5bbe224198ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.094494] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-0a11a182-3e5b-420e-a4db-5bbe224198ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.094859] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-0a11a182-3e5b-420e-a4db-5bbe224198ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.095031] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a11a182-3e5b-420e-a4db-5bbe224198ed',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.265551] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06966f07-554f-446e-a2a7-17a62c52a519: rpc.has_security_group_logging(os_id): False [ 1246.282914] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.283155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.283155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.283344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.283435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.283625] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.283720] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.283787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.283940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.284041] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.284302] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.284443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.284443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.284589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.284663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.284847] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.284970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.285026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.285205] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.285289] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.285377] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1246.291066] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.291262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.291389] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.291587] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.291678] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.291857] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.291954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.292033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.292202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.292281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.292368] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1246.315242] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.315427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.315427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.315645] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.315791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.324714] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1246.362498] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.362711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.362711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.362921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.363128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.387246] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1246.598033] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.598033] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.598033] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.598232] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.598399] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.598564] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 0a11a182-3e5b-420e-a4db-5bbe224198ed not found, creating... [ 1246.598824] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.598984] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.599125] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.599356] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.599499] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.599781] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.599941] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.600075] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.600290] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.600433] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.600572] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 0a11a182-3e5b-420e-a4db-5bbe224198ed is going to be created. [ 1246.621260] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.621506] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.621614] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.621896] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.622221] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.622470] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-0a11a182-3e5b-420e-a4db-5bbe224198ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.292589] env[69656]: INFO networking_nsxv3.common.synchronization [req-38f087bd-662c-47aa-bd1b-eb9b1952bc56 req-a370b1ca-48ab-40c4-b798-27d72c4efa60 service nova] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_rules [ 1247.292833] env[69656]: INFO networking_nsxv3.common.synchronization [req-38f087bd-662c-47aa-bd1b-eb9b1952bc56 req-a370b1ca-48ab-40c4-b798-27d72c4efa60 service nova] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1247.292924] env[69656]: INFO networking_nsxv3.common.synchronization [req-38f087bd-662c-47aa-bd1b-eb9b1952bc56 req-a370b1ca-48ab-40c4-b798-27d72c4efa60 service nova] Enqueued Resource ID: 0a11a182-3e5b-420e-a4db-5bbe224198ed with Priority: HIGHEST for action port [ 1247.293171] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_rules [ 1247.293302] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1247.293400] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a11a182-3e5b-420e-a4db-5bbe224198ed with Priority: HIGHEST for action port [ 1247.293933] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.294098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.294206] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.294385] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.294466] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.295729] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.295824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.296024] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a11a182-3e5b-420e-a4db-5bbe224198ed taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.296126] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a11a182-3e5b-420e-a4db-5bbe224198ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.296216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a11a182-3e5b-420e-a4db-5bbe224198ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.296360] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a11a182-3e5b-420e-a4db-5bbe224198ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.296433] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a11a182-3e5b-420e-a4db-5bbe224198ed',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.802339] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.802339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.802339] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a11a182-3e5b-420e-a4db-5bbe224198ed with status ACTIVE [ 1247.802339] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.802339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.802339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.802339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.802339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.802339] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.802339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.802339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.802339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.802339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.802339] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.802902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.802902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.802902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.802902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.802902] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a11a182-3e5b-420e-a4db-5bbe224198ed is going to be updated. [ 1247.825327] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.825478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.825523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.825705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.825832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.825983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a11a182-3e5b-420e-a4db-5bbe224198ed" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.998702] env[69656]: INFO networking_nsxv3.common.synchronization [req-04137e73-6633-4f16-9b2b-915dcdee1c54 req-c9e2f1f1-149a-496e-8937-7913cb29a047 tempest-ServerActionsTestJSON-1918891154 tempest-ServerActionsTestJSON-1918891154-project-member] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1247.999232] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1247.999525] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.999647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.999716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.999966] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.000136] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.000241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.000304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.000483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.000583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.000696] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.279322] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.279531] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.279659] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.280334] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.280608] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.280772] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.280901] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.281144] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.281299] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.281511] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1248.281632] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1248.281812] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1248.281997] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1248.282173] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1248.282298] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1248.282437] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1248.303107] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1248.303363] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1248.303416] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1248.303600] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.303896] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-9077eb9e-fdef-48fa-91e8-737ce43a6952 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.304091] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-9077eb9e-fdef-48fa-91e8-737ce43a6952" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.304230] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-9077eb9e-fdef-48fa-91e8-737ce43a6952" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.304516] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-9077eb9e-fdef-48fa-91e8-737ce43a6952" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.304660] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9077eb9e-fdef-48fa-91e8-737ce43a6952',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.334852] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1248.335048] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 deletion is rescheduled due to dependency. [ 1248.335224] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.335337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.335543] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.335723] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.335834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.335900] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.336074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.336147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.336238] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.402482] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1248.402695] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.502898] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.503154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.503267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.503583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.503730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.504093] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.504234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.504333] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.504498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.504581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.504670] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 already deleted. [ 1248.504749] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.807176] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.807424] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.807560] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.807850] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.808015] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.808186] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 9077eb9e-fdef-48fa-91e8-737ce43a6952 not found, creating... [ 1248.808448] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.808611] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.808732] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.808962] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.809123] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.809407] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.809566] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.809688] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.810083] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.810083] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.810185] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 9077eb9e-fdef-48fa-91e8-737ce43a6952 is going to be created. [ 1248.829649] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.829824] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.829953] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.830201] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.830423] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.830638] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-9077eb9e-fdef-48fa-91e8-737ce43a6952" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.837953] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.339430] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.583630] env[69656]: INFO networking_nsxv3.common.synchronization [req-04137e73-6633-4f16-9b2b-915dcdee1c54 req-8c0bb4a8-bbec-40fd-b6c9-ef38db53fae8 service nova] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_rules [ 1249.583752] env[69656]: INFO networking_nsxv3.common.synchronization [req-04137e73-6633-4f16-9b2b-915dcdee1c54 req-8c0bb4a8-bbec-40fd-b6c9-ef38db53fae8 service nova] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1249.583890] env[69656]: INFO networking_nsxv3.common.synchronization [req-04137e73-6633-4f16-9b2b-915dcdee1c54 req-8c0bb4a8-bbec-40fd-b6c9-ef38db53fae8 service nova] Enqueued Resource ID: 9077eb9e-fdef-48fa-91e8-737ce43a6952 with Priority: HIGHEST for action port [ 1249.584467] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_rules [ 1249.584627] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1249.584684] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9077eb9e-fdef-48fa-91e8-737ce43a6952 with Priority: HIGHEST for action port [ 1249.584944] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.585134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.585212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.585412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.585495] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.586299] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.586413] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.586473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.586632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.586774] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.586868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.586926] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.587143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.587176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.587244] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.587932] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-9077eb9e-fdef-48fa-91e8-737ce43a6952 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.588054] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9077eb9e-fdef-48fa-91e8-737ce43a6952" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.588133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9077eb9e-fdef-48fa-91e8-737ce43a6952" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.588258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9077eb9e-fdef-48fa-91e8-737ce43a6952" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.588331] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9077eb9e-fdef-48fa-91e8-737ce43a6952',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.842755] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.842874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.842941] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.843170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.843292] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.843403] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1249.873338] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.873544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.873544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.873784] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.873931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.881510] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1250.090179] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.091368] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.091479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.091686] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9077eb9e-fdef-48fa-91e8-737ce43a6952 with status ACTIVE [ 1250.091878] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.092013] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.092105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.092335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.092433] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.092628] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.092728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.092804] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.092997] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.093126] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.093315] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.093398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.093474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.093655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.093740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.093989] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9077eb9e-fdef-48fa-91e8-737ce43a6952 is going to be updated. [ 1250.112955] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.113131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.113180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.113404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.113536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.113698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9077eb9e-fdef-48fa-91e8-737ce43a6952" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.432291] env[69656]: INFO networking_nsxv3.common.synchronization [None req-0ebed276-c1ae-4afc-8dcd-e88696da5ee3 tempest-AttachVolumeShelveTestJSON-958915703 tempest-AttachVolumeShelveTestJSON-958915703-project-member] Enqueued Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_rules [ 1250.432842] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_rules [ 1250.433206] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.433540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.433540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.433765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.433873] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.518535] env[69656]: INFO networking_nsxv3.common.synchronization [None req-ec8cfa4a-9210-4368-8765-351bf657e3ab tempest-AttachVolumeShelveTestJSON-958915703 tempest-AttachVolumeShelveTestJSON-958915703-project-member] Enqueued Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_rules [ 1250.519546] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_rules [ 1250.519921] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.520094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.596493] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.954625] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.954625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.954625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.954625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.954625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.954625] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 already deleted. [ 1250.954625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.954625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.954625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.954625] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.098492] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.098739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.098739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.099602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.099602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.099602] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 is going to be created. [ 1251.121476] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.121595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.121656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.122202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.122202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.130860] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: UNINITIALIZED for 2s [ 1251.476470] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.476470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.476470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.476470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.476470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.476470] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 already deleted. [ 1251.476470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.891152] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1251.891419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.891607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.891863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.892250] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.892385] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.892482] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.892682] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.892768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.892874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.892972] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.395037] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.395258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.395332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.395554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.395729] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.395828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.395885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.396043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.396131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.396241] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.396388] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.396500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.396561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.396702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.396836] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.396926] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.396977] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.397145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.397232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.397324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.397403] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.901855] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3274dea2-eaf7-4169-ba91-1154eac58032: rpc.has_security_group_logging(os_id): False [ 1252.918934] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.918934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.918934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.919201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.919201] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.919316] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.919419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.919483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.919635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.919713] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.919897] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.920015] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.920061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.920203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.920279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.920459] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.920551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.920606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.920744] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.920846] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.920968] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1252.982224] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.982395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.982479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.982714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.982885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.024644] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1253.144322] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: SUCCESS [ 1253.144930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.145138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.145420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.145650] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.145823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.145899] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.146085] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.146169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.146257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.146346] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.511707] env[69656]: INFO networking_nsxv3.common.synchronization [req-80b267cf-35af-4b50-b908-97793105709f req-6ada27ec-0a36-4b88-a949-ee36ef4e7728 tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_members [ 1253.512654] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_members [ 1253.512654] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3521005-0bf3-4791-8930-fe6bb6c94423 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.512806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.512806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.513094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.513152] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.513280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.513406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.513462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.513525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.513622] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.522065] env[69656]: INFO networking_nsxv3.common.synchronization [req-2a087567-bcaa-4802-8561-84a6e7ea9b2b req-62eb710a-1105-4116-b7ca-094dbe3a1809 tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1253.522385] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1253.523682] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.523832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.523832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.523965] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.524144] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.524251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.524354] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.524504] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.524584] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.524754] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.648949] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.017690] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.027790] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.152266] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8: rpc.has_security_group_logging(os_id): False [ 1254.169947] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.170129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.170221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.170404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.170486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.170725] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.170816] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.170885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.171052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.171133] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.171219] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 is going to be created. [ 1254.229920] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.230088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.230166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.230530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.230630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.241305] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: IN_PROGRESS for 2s [ 1254.521116] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.529733] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.024105] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.024497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.024497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.024649] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.024738] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.024836] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3521005-0bf3-4791-8930-fe6bb6c94423 is going to be updated. [ 1255.031958] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.032076] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.032148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.032316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.032401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.032489] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1255.052121] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1255.052285] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.059206] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.059327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.059398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.059575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.059713] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.067340] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: IN_PROGRESS for 2s [ 1255.070824] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.070925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.070995] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.071172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.071299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.077270] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1256.251941] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: SUCCESS [ 1256.252423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.290567] env[69656]: INFO networking_nsxv3.common.synchronization [req-037fe2db-4975-48bc-90e5-a4c6e7d45880 req-492ef359-3dba-41b0-959c-68aa06d0514b tempest-AttachVolumeShelveTestJSON-958915703 tempest-AttachVolumeShelveTestJSON-958915703-project-member] Enqueued Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_members [ 1256.291109] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_members [ 1256.291413] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5f15371-c02b-43e4-b8a5-670ce8c4b232 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.291536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.291594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.291828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.291979] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.296181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.296267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.296431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.296538] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.296609] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.572340] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-152 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.572555] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.572689] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.572976] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.573261] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.573427] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.573550] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.573772] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.573923] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.574192] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1256.574300] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1256.574438] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1256.574559] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1256.574677] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1256.574789] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1256.574923] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1256.594308] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1256.594589] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1256.594793] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1256.595051] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.595556] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-9b086c0a-326a-415b-88a9-4022668f9f15 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.595756] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.595891] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.596261] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.596439] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b086c0a-326a-415b-88a9-4022668f9f15',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.800271] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.800477] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.800596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.800842] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.800945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.801162] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.801265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.801494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.801494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.801571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.801665] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 already deleted. [ 1256.801754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.077052] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: SUCCESS [ 1257.077313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.083679] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1257.083916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.099856] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.100827] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.100827] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.102180] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.102180] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.102180] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 9b086c0a-326a-415b-88a9-4022668f9f15 not found, creating... [ 1257.102319] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.102567] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.103087] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.103401] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.103597] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.104025] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.105176] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.105176] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.105176] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.105176] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.105805] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 9b086c0a-326a-415b-88a9-4022668f9f15 is going to be created. [ 1257.125638] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.125983] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.126195] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.126539] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.126953] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.129400] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.845602] env[69656]: INFO networking_nsxv3.common.synchronization [req-037fe2db-4975-48bc-90e5-a4c6e7d45880 req-3dce675a-2f08-458d-8005-30e0028e1872 service nova] Enqueued Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_rules [ 1257.845929] env[69656]: INFO networking_nsxv3.common.synchronization [req-037fe2db-4975-48bc-90e5-a4c6e7d45880 req-3dce675a-2f08-458d-8005-30e0028e1872 service nova] Enqueued Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_members [ 1257.845929] env[69656]: INFO networking_nsxv3.common.synchronization [req-037fe2db-4975-48bc-90e5-a4c6e7d45880 req-3dce675a-2f08-458d-8005-30e0028e1872 service nova] Enqueued Resource ID: 9b086c0a-326a-415b-88a9-4022668f9f15 with Priority: HIGHEST for action port [ 1257.846164] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_rules [ 1257.846305] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_members [ 1257.846390] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b086c0a-326a-415b-88a9-4022668f9f15 with Priority: HIGHEST for action port [ 1257.846941] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.847086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.847148] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.847376] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.847461] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.848307] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5f15371-c02b-43e4-b8a5-670ce8c4b232 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.848473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.848473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.848629] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.848794] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.848862] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.848942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.849061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.849197] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.849251] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.851296] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b086c0a-326a-415b-88a9-4022668f9f15 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.851406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.851467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.851609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.851672] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b086c0a-326a-415b-88a9-4022668f9f15',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.352974] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5f15371-c02b-43e4-b8a5-670ce8c4b232 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.353191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.353378] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.354298] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b086c0a-326a-415b-88a9-4022668f9f15 with status ACTIVE [ 1258.354525] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.354630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.354701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.354941] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.355043] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.355269] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.355381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.355447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.355621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.355692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.355921] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.358408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.358525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.360851] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.360851] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.360851] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b086c0a-326a-415b-88a9-4022668f9f15 is going to be updated. [ 1258.379037] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.379215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.379300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.379507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.379646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.379806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.862052] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.363603] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.363859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.363859] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.364381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.364533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.364672] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 is going to be created. [ 1259.387387] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.387387] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.388040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.388040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.388040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.396343] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 in Status: UNINITIALIZED for 2s [ 1260.007778] env[69656]: INFO networking_nsxv3.common.synchronization [req-eb117630-b0b7-4391-974f-f10d848ea950 req-73420c19-d1d4-48cf-965d-0a5ce67f732d tempest-ServersTestJSON-797164957 tempest-ServersTestJSON-797164957-project-member] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1260.008563] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGHEST for action security_group_members [ 1260.008563] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.008732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.008732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.008876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.009474] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.009474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.009474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.009474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.009829] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.009829] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.512620] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.512620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.512847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.512900] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.512951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.513153] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.513250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.513303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.513453] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.513527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.513611] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be updated. [ 1260.538365] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.538594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.538724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.539050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.539283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.547691] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: IN_PROGRESS for 2s [ 1261.405054] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 in Status: SUCCESS [ 1261.405469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.405469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.405614] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.405882] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.406017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.406115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.406315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.406437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.406571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.406677] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.909195] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.413040] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5f15371-c02b-43e4-b8a5-670ce8c4b232: rpc.has_security_group_logging(os_id): False [ 1262.431200] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.431486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.431486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.431710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.431710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.431901] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.432070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.432070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.432228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.432329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.432400] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 is going to be created. [ 1262.488289] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.488535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.488656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.489008] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.489393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.501618] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 in Status: IN_PROGRESS for 2s [ 1262.557934] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06966f07-554f-446e-a2a7-17a62c52a519 in Status: SUCCESS [ 1262.558156] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 deletion is rescheduled due to dependency. [ 1262.558283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.514408] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 in Status: SUCCESS [ 1264.514654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.897387] env[69656]: INFO networking_nsxv3.common.synchronization [req-e8093f9a-5967-48e3-b560-0735f76bb100 req-dfa04477-b181-4fbb-9075-32482523492e tempest-ServerActionsTestOtherA-1928161452 tempest-ServerActionsTestOtherA-1928161452-project-member] Enqueued Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_members [ 1264.898358] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3521005-0bf3-4791-8930-fe6bb6c94423 with Priority: HIGHEST for action security_group_members [ 1264.898358] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3521005-0bf3-4791-8930-fe6bb6c94423 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.898358] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.898561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.899301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.899301] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.899301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.899301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.899301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.899654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.899654] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3521005-0bf3-4791-8930-fe6bb6c94423',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.402337] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.402578] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.402679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.402928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.403057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.403288] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.403510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.403510] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.403686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.403778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.403873] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3521005-0bf3-4791-8930-fe6bb6c94423 is going to be updated. [ 1265.434605] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.434751] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.434790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.435176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.435261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.443163] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: IN_PROGRESS for 2s [ 1267.454063] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3521005-0bf3-4791-8930-fe6bb6c94423 in Status: SUCCESS [ 1267.454539] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3521005-0bf3-4791-8930-fe6bb6c94423 deletion is rescheduled due to dependency. [ 1267.454539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3521005-0bf3-4791-8930-fe6bb6c94423" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.900181] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.900181] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1270.306055] env[69656]: INFO networking_nsxv3.common.synchronization [req-17f507a1-cf40-4318-abc2-49ae294845c5 req-610f117c-a71a-4a82-8594-cf493e2472ae tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGHEST for action security_group_members [ 1270.306870] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGHEST for action security_group_members [ 1270.306870] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-38729b4b-23ae-4e26-b524-9c3d018d87eb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.307290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.307412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.308250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.308328] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.308454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.308740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.308944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.309077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.309200] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38729b4b-23ae-4e26-b524-9c3d018d87eb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.812007] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.812176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.812259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.812498] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.812590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.812790] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.812890] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.812949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.813111] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.813186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.813313] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb is going to be updated. [ 1270.839969] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.839969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.839969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.839969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.841663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.848525] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb in Status: IN_PROGRESS for 2s [ 1272.861376] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb in Status: SUCCESS [ 1272.861376] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb deletion is rescheduled due to dependency. [ 1272.861376] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.958875] env[69656]: INFO networking_nsxv3.common.synchronization [None req-80f03b57-43a1-4297-a063-37105cbd018a None None] Enqueued Resource ID: 254d6053-9ff8-4b9f-80d1-13f1451b8abf with Priority: HIGHEST for action port [ 1272.958875] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 254d6053-9ff8-4b9f-80d1-13f1451b8abf with Priority: HIGHEST for action port [ 1272.958875] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-254d6053-9ff8-4b9f-80d1-13f1451b8abf taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.958875] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-254d6053-9ff8-4b9f-80d1-13f1451b8abf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.958875] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-254d6053-9ff8-4b9f-80d1-13f1451b8abf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.959636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-254d6053-9ff8-4b9f-80d1-13f1451b8abf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.960933] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('254d6053-9ff8-4b9f-80d1-13f1451b8abf',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.465255] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 254d6053-9ff8-4b9f-80d1-13f1451b8abf [ 1273.465255] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.465255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.465255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.465255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.465255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.465255] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:254d6053-9ff8-4b9f-80d1-13f1451b8abf already deleted. [ 1273.465255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-254d6053-9ff8-4b9f-80d1-13f1451b8abf" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.487300] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f3a0be08-f934-46ae-9a87-591b443da20a tempest-ServerActionsV293TestJSON-1538650303 tempest-ServerActionsV293TestJSON-1538650303-project-member] Enqueued Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGHEST for action security_group_rules [ 1273.487300] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGHEST for action security_group_rules [ 1273.487300] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.487300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.487300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.487300] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.487300] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbfd950d-8069-4f04-a8ec-2ff80f29dc2a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.579862] env[69656]: INFO networking_nsxv3.common.synchronization [None req-5c6f98ad-2a14-4a36-9750-9176eb93859a tempest-ServerActionsV293TestJSON-1538650303 tempest-ServerActionsV293TestJSON-1538650303-project-member] Enqueued Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGHEST for action security_group_rules [ 1273.580495] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGHEST for action security_group_rules [ 1273.581345] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.581345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.006502] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.006807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.006807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.007074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.007212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.007329] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a already deleted. [ 1274.007457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.007666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.007857] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.007982] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbfd950d-8069-4f04-a8ec-2ff80f29dc2a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.528666] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.528873] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.528939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.529305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.529305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.529407] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a already deleted. [ 1274.529446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.118734] env[69656]: INFO networking_nsxv3.common.synchronization [None req-8b1ca2ed-6cbb-46cd-8a85-7fbbc522fe79 tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGHEST for action security_group_rules [ 1275.119268] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGHEST for action security_group_rules [ 1275.119567] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b0f9291-4852-4d43-9155-e275aacce00d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.119689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.119754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.120084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.122513] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b0f9291-4852-4d43-9155-e275aacce00d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.176735] env[69656]: INFO networking_nsxv3.common.synchronization [None req-998cb37c-150e-46de-b306-e9723ff61a2d None None] Enqueued Resource ID: 4941f3c6-d0ab-4e4d-843f-9e238f6c6333 with Priority: HIGHEST for action port [ 1275.177843] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4941f3c6-d0ab-4e4d-843f-9e238f6c6333 with Priority: HIGHEST for action port [ 1275.178245] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-4941f3c6-d0ab-4e4d-843f-9e238f6c6333 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.178411] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4941f3c6-d0ab-4e4d-843f-9e238f6c6333" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.178553] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4941f3c6-d0ab-4e4d-843f-9e238f6c6333" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.178885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4941f3c6-d0ab-4e4d-843f-9e238f6c6333" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.178989] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4941f3c6-d0ab-4e4d-843f-9e238f6c6333',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.188319] env[69656]: INFO networking_nsxv3.common.synchronization [None req-0bd9f200-8e69-40c5-91cb-5fa617068979 tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGHEST for action security_group_rules [ 1275.188368] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGHEST for action security_group_rules [ 1275.188945] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b0f9291-4852-4d43-9155-e275aacce00d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.189069] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.641273] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.641418] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.641494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.641711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.641802] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.641896] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b0f9291-4852-4d43-9155-e275aacce00d already deleted. [ 1275.641978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.642138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.642327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.642428] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b0f9291-4852-4d43-9155-e275aacce00d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.680381] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4941f3c6-d0ab-4e4d-843f-9e238f6c6333 [ 1275.680733] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.680837] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.680837] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.681047] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.681257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.681340] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4941f3c6-d0ab-4e4d-843f-9e238f6c6333 already deleted. [ 1275.681432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4941f3c6-d0ab-4e4d-843f-9e238f6c6333" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.162446] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.162776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.162776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.162926] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.163024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.163123] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b0f9291-4852-4d43-9155-e275aacce00d already deleted. [ 1276.163208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.462091] env[69656]: INFO networking_nsxv3.common.synchronization [req-e0d8c429-f525-4866-bcde-ae1c0e785020 req-217bf10a-a04a-45eb-8d62-50a329796658 tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1279.462573] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1279.462899] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.463032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.463101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.463316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.463475] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.463573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.463631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.463777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.463898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.463951] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.739106] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.739310] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.739441] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.739732] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.739994] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.740168] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.740289] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.740513] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.740691] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.740912] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.741041] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1279.741227] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1279.741393] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1279.741524] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.741643] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1279.741802] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1279.761106] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1279.761287] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1279.761438] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1279.761672] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.761997] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.762189] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.762315] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.762700] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.762845] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.966583] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.966819] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.966819] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.967021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.967126] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.967340] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.967444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.967499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.967656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.967735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.967818] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be updated. [ 1279.990756] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.991027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.991027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.991139] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.991279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.999276] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1280.265205] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.265431] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.265714] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.266056] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.266255] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.266454] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc not found, creating... [ 1280.266778] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.266933] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.267078] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.267304] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.267449] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.267771] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.267961] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.268100] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.268312] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.268452] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.268594] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc is going to be created. [ 1280.286783] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.286946] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.287097] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.287350] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.287579] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.287804] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.557725] env[69656]: INFO networking_nsxv3.common.synchronization [req-12402db7-a3e4-46a4-943e-5c2db04926a2 req-f119074a-a62c-4d85-993c-789d898f6fc0 tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGHEST for action security_group_members [ 1280.558239] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGHEST for action security_group_members [ 1280.558534] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0f9291-4852-4d43-9155-e275aacce00d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.558657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.558715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.559020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.559176] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.559279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.559343] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.559481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.559569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.559668] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0f9291-4852-4d43-9155-e275aacce00d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.816621] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-565 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.816824] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.816954] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.817243] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.817496] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.817657] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.817778] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.817989] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.818151] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.818404] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1280.818523] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1280.818974] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1280.818974] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1280.818974] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1280.819111] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1280.819196] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1280.836086] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1280.836249] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1280.836431] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1280.836538] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-565" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.836878] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-75e35edf-a05a-459a-96d8-cabdec45b3d0 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.837049] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-75e35edf-a05a-459a-96d8-cabdec45b3d0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.837177] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-75e35edf-a05a-459a-96d8-cabdec45b3d0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.837466] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-75e35edf-a05a-459a-96d8-cabdec45b3d0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.837609] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75e35edf-a05a-459a-96d8-cabdec45b3d0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.954660] env[69656]: INFO networking_nsxv3.common.synchronization [req-e0d8c429-f525-4866-bcde-ae1c0e785020 req-8e159214-9752-4e50-8dcf-5be3e42e7f91 service nova] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_rules [ 1280.954768] env[69656]: INFO networking_nsxv3.common.synchronization [req-e0d8c429-f525-4866-bcde-ae1c0e785020 req-8e159214-9752-4e50-8dcf-5be3e42e7f91 service nova] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1280.954909] env[69656]: INFO networking_nsxv3.common.synchronization [req-e0d8c429-f525-4866-bcde-ae1c0e785020 req-8e159214-9752-4e50-8dcf-5be3e42e7f91 service nova] Enqueued Resource ID: a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc with Priority: HIGHEST for action port [ 1280.955413] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_rules [ 1280.955563] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1280.955663] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc with Priority: HIGHEST for action port [ 1280.955936] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.956116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.956182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.956382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.956461] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.957545] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.957644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.957839] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.958121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.958121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.958288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.958341] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.061975] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.062149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.062221] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.062426] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.062533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.062732] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.062831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.062892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.063057] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.063135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.063218] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0f9291-4852-4d43-9155-e275aacce00d already deleted. [ 1281.063294] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.339981] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.340266] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.340429] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.340701] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.340859] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.341031] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 75e35edf-a05a-459a-96d8-cabdec45b3d0 not found, creating... [ 1281.341339] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.341508] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.341630] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.341874] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.342043] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.342354] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.342546] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.342679] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.342888] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.343037] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.343182] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 75e35edf-a05a-459a-96d8-cabdec45b3d0 is going to be created. [ 1281.367256] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.367256] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.367256] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.367256] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.367256] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.367256] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-75e35edf-a05a-459a-96d8-cabdec45b3d0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.461712] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.461837] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.462066] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc with status ACTIVE [ 1281.462246] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.462348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.462415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.462616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.462716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.462878] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.463024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.463024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.463191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.463260] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.463437] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.463566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.463653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.463735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.463819] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.463891] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc is going to be updated. [ 1281.485078] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.485337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.485337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.485532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.485579] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.485702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0b9d98d-b5f6-474d-aa4b-85ba0828e5dc" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.009051] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1282.009347] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e deletion is rescheduled due to dependency. [ 1282.009347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.009505] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.009723] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.009914] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.010044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.010108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.010265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.010348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.010442] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.045968] env[69656]: INFO networking_nsxv3.common.synchronization [req-12402db7-a3e4-46a4-943e-5c2db04926a2 req-65a0d567-1338-4b14-b679-3ee623dbccfc service nova] Enqueued Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGHEST for action security_group_rules [ 1282.045968] env[69656]: INFO networking_nsxv3.common.synchronization [req-12402db7-a3e4-46a4-943e-5c2db04926a2 req-65a0d567-1338-4b14-b679-3ee623dbccfc service nova] Enqueued Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGHEST for action security_group_members [ 1282.045968] env[69656]: INFO networking_nsxv3.common.synchronization [req-12402db7-a3e4-46a4-943e-5c2db04926a2 req-65a0d567-1338-4b14-b679-3ee623dbccfc service nova] Enqueued Resource ID: 75e35edf-a05a-459a-96d8-cabdec45b3d0 with Priority: HIGHEST for action port [ 1282.045968] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGHEST for action security_group_rules [ 1282.046181] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGHEST for action security_group_members [ 1282.046219] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e35edf-a05a-459a-96d8-cabdec45b3d0 with Priority: HIGHEST for action port [ 1282.047568] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b0f9291-4852-4d43-9155-e275aacce00d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.047568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.047568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.047568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.047568] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b0f9291-4852-4d43-9155-e275aacce00d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.047991] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0f9291-4852-4d43-9155-e275aacce00d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.048058] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.048117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.048286] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.048780] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.048780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.048907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.050022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.050022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.050022] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0f9291-4852-4d43-9155-e275aacce00d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.050022] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-75e35edf-a05a-459a-96d8-cabdec45b3d0 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.050022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75e35edf-a05a-459a-96d8-cabdec45b3d0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.050022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75e35edf-a05a-459a-96d8-cabdec45b3d0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.050562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75e35edf-a05a-459a-96d8-cabdec45b3d0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.050562] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75e35edf-a05a-459a-96d8-cabdec45b3d0',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.512971] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.551956] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0f9291-4852-4d43-9155-e275aacce00d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.552176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.552246] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b0f9291-4852-4d43-9155-e275aacce00d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.553268] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75e35edf-a05a-459a-96d8-cabdec45b3d0 with status ACTIVE [ 1282.553268] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.553435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.553435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.553609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.553697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.553960] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.553960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.554126] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.554171] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.554248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.554424] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.554564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.554609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.554759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.554833] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.554914] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75e35edf-a05a-459a-96d8-cabdec45b3d0 is going to be updated. [ 1282.575586] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.575739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.575799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.576022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.576163] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.576318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75e35edf-a05a-459a-96d8-cabdec45b3d0" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.015941] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.056920] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b0f9291-4852-4d43-9155-e275aacce00d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.519147] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.519287] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.519367] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.519681] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.519791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.519889] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be updated. [ 1283.547243] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.547338] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.547377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.547579] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.547730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.556956] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1283.559356] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.559485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.559556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.559738] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.559822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.559913] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0f9291-4852-4d43-9155-e275aacce00d is going to be created. [ 1283.582877] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.583061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.583128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.583272] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.583424] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.593767] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0f9291-4852-4d43-9155-e275aacce00d in Status: UNINITIALIZED for 2s [ 1285.565978] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1285.566272] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.566395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.566622] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.566834] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.566971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.567071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.567266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.567357] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.567445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.567541] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.601431] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0f9291-4852-4d43-9155-e275aacce00d in Status: SUCCESS [ 1285.601649] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.601773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.601970] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.602174] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.602287] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.602353] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.602537] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.602646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.602693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.602760] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b0f9291-4852-4d43-9155-e275aacce00d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.070164] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.070375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.070454] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.070621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.070921] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.071032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.071032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.071172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.071256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.071344] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.071508] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.071602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.071660] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.071964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.072052] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.072107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.072216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.072363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.072440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.072540] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.072631] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.077841] env[69656]: INFO networking_nsxv3.common.synchronization [None req-6d3d9cd7-0c25-4fab-8a28-2fed5a8c89e4 tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1286.078600] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1286.078661] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.078785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.078831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.079456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.079456] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.079456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.079456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.079741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.079741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.079741] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.104988] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b0f9291-4852-4d43-9155-e275aacce00d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.575604] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c40e462-de5f-44fc-812b-8caf1dff4c9e: rpc.has_security_group_logging(os_id): False [ 1286.581942] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.592082] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.592225] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.592273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.592475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.592571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.592790] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.592893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.592955] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.593129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.593206] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.593398] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.593490] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.593551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.593688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.593761] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.593932] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.594032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.594092] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.594227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.594299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.594379] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be updated. [ 1286.608592] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b0f9291-4852-4d43-9155-e275aacce00d: rpc.has_security_group_logging(os_id): False [ 1286.622752] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.622860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.622928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.623109] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.623188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.624469] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.624469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.624469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.624469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.624469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.624469] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b0f9291-4852-4d43-9155-e275aacce00d is going to be created. [ 1286.655891] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.656078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.656124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.656306] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.656450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.668141] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1286.677766] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.677903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.678017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.678215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.678389] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.689428] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0f9291-4852-4d43-9155-e275aacce00d in Status: IN_PROGRESS for 2s [ 1287.083653] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.586615] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.586943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.586943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.587226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.587334] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.587455] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be updated. [ 1287.614397] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.614643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.614733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.614971] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.615160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.623194] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1288.106506] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.106645] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.106749] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.107062] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.107352] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.107522] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.107665] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.107906] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.108071] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.108305] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1288.108435] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1288.108548] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1288.108742] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1288.108806] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1288.108905] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1288.109042] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1288.125927] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1288.126113] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1288.126268] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1288.126446] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.126924] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-d43e7c68-8c11-4d1b-9150-339724443bef taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.127151] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-d43e7c68-8c11-4d1b-9150-339724443bef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.127282] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-d43e7c68-8c11-4d1b-9150-339724443bef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.127601] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-d43e7c68-8c11-4d1b-9150-339724443bef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.127761] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d43e7c68-8c11-4d1b-9150-339724443bef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.629540] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.629961] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.629961] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.630185] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.630418] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.630582] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port d43e7c68-8c11-4d1b-9150-339724443bef not found, creating... [ 1288.630923] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.631127] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.631250] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.631474] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.631614] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.631902] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.632071] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.632192] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.632474] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.632694] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.632845] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: d43e7c68-8c11-4d1b-9150-339724443bef is going to be created. [ 1288.652114] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.652323] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.652508] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.652776] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.653027] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.653263] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-d43e7c68-8c11-4d1b-9150-339724443bef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.688103] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1288.688343] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.706190] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0f9291-4852-4d43-9155-e275aacce00d in Status: SUCCESS [ 1288.706480] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.017370] env[69656]: INFO networking_nsxv3.common.synchronization [req-07326d2d-f292-4a26-a465-5ac6d7e012fe req-ed73c0f5-a2ad-4868-869d-b5ce065c2638 tempest-DeleteServersTestJSON-708906239 tempest-DeleteServersTestJSON-708906239-project-member] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1289.017779] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGHEST for action security_group_members [ 1289.018127] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.018251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.018320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.018583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.018769] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.018892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.018955] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.019187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.019282] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.019377] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.342465] env[69656]: INFO networking_nsxv3.common.synchronization [req-a465acee-096a-4797-8d0a-5e3eadabb255 req-3a161144-916e-4dc7-92cf-960dd811d824 service nova] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_rules [ 1289.342649] env[69656]: INFO networking_nsxv3.common.synchronization [req-a465acee-096a-4797-8d0a-5e3eadabb255 req-3a161144-916e-4dc7-92cf-960dd811d824 service nova] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1289.342750] env[69656]: INFO networking_nsxv3.common.synchronization [req-a465acee-096a-4797-8d0a-5e3eadabb255 req-3a161144-916e-4dc7-92cf-960dd811d824 service nova] Enqueued Resource ID: d43e7c68-8c11-4d1b-9150-339724443bef with Priority: HIGHEST for action port [ 1289.342973] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_rules [ 1289.343117] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1289.343214] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e7c68-8c11-4d1b-9150-339724443bef with Priority: HIGHEST for action port [ 1289.343844] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.343989] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.344107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.344312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.344425] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.345311] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.345448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.346087] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-d43e7c68-8c11-4d1b-9150-339724443bef taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.346087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d43e7c68-8c11-4d1b-9150-339724443bef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.346087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d43e7c68-8c11-4d1b-9150-339724443bef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.346087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d43e7c68-8c11-4d1b-9150-339724443bef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.346087] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d43e7c68-8c11-4d1b-9150-339724443bef',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.521186] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.521378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.521430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.521621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.521834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.521991] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.522113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.522174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.522332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.522405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.522507] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be updated. [ 1289.553205] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.553417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.553417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.553621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.553749] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.562337] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: IN_PROGRESS for 2s [ 1289.633103] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1289.633532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.633532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.633740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.633892] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.634026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.634097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.634251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.634338] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.634404] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.848461] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.848584] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.848778] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d43e7c68-8c11-4d1b-9150-339724443bef with status ACTIVE [ 1289.848943] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.849060] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.849124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.849341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.849427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.849590] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.849677] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.849741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.849886] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.849961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.850149] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.850232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.850293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.850442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.850517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.850599] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d43e7c68-8c11-4d1b-9150-339724443bef is going to be updated. [ 1289.870291] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.870489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.870560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.870722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.870860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.871030] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d43e7c68-8c11-4d1b-9150-339724443bef" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.136752] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.639928] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.141800] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.142075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.142075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.142251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.142338] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.142484] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be updated. [ 1291.170699] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.170990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.170990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.171144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.171278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.179249] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1291.571152] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3274dea2-eaf7-4169-ba91-1154eac58032 in Status: SUCCESS [ 1291.571327] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 deletion is rescheduled due to dependency. [ 1291.571437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.200471] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1293.200734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.200908] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.201219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.201437] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.201573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.201662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.201864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.201982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.202115] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.202233] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.704614] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.704850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.704850] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.705217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.705513] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.705637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.705637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.705822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.705932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.706061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.706262] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.706381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.706449] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.706624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.706789] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.706910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.706991] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.707178] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.707279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.707384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.707506] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.210460] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c40e462-de5f-44fc-812b-8caf1dff4c9e: rpc.has_security_group_logging(os_id): False [ 1294.228859] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.229095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.229095] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.229309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.229397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.229590] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.229688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.229749] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.229889] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.229982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.230178] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.230263] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.230328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.230460] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.230534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.230712] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.230801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.230860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.230987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.231064] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.231150] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be updated. [ 1294.289740] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.289740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.289740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.289740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.290777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.307602] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1294.344238] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1294.344460] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1296.322690] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1296.323044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.114935] env[69656]: INFO networking_nsxv3.common.synchronization [req-872c369c-25c1-46cd-967d-bc0284611273 req-d09743aa-c21f-4564-a616-a15ca58fc4e4 tempest-ServerActionsV293TestJSON-1538650303 tempest-ServerActionsV293TestJSON-1538650303-project-member] Enqueued Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGHEST for action security_group_members [ 1297.115605] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGHEST for action security_group_members [ 1297.117582] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.117582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.117582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.117582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.117582] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.117582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.117582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.117582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.117582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.117582] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbfd950d-8069-4f04-a8ec-2ff80f29dc2a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.613949] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.614309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-873" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.614423] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-873" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.614840] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-873" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.615190] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.616168] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.616168] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.616168] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.616168] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.616385] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1297.616385] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1297.616549] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1297.616688] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1297.616844] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1297.617063] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1297.617225] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1297.619319] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.619455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.619853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.619853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.619976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.620219] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.620347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.620423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.620590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.620676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.620786] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a already deleted. [ 1297.620888] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.636371] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1297.636562] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1297.636761] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1297.636947] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-873" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.637319] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-b15f114c-1515-4687-b7db-f4ddef324a4a taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.637504] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-b15f114c-1515-4687-b7db-f4ddef324a4a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.637632] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-b15f114c-1515-4687-b7db-f4ddef324a4a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.637957] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-b15f114c-1515-4687-b7db-f4ddef324a4a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.638185] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b15f114c-1515-4687-b7db-f4ddef324a4a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.141136] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.141447] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.141583] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.141938] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.142186] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.142427] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port b15f114c-1515-4687-b7db-f4ddef324a4a not found, creating... [ 1298.142833] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.143034] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.143168] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.143409] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.143556] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.143874] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.144309] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.144469] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.144767] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.144940] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.145186] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: b15f114c-1515-4687-b7db-f4ddef324a4a is going to be created. [ 1298.170126] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.170746] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.170842] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.171059] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.171304] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.171538] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-b15f114c-1515-4687-b7db-f4ddef324a4a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.521442] env[69656]: INFO networking_nsxv3.common.synchronization [None req-c7ab1e12-0607-493b-9359-caac614d2840 None None] Enqueued Resource ID: 5decd698-1e9c-4e2d-a7c8-39d52a65c07d with Priority: HIGHEST for action port [ 1298.521711] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5decd698-1e9c-4e2d-a7c8-39d52a65c07d with Priority: HIGHEST for action port [ 1298.522296] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-5decd698-1e9c-4e2d-a7c8-39d52a65c07d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.523105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5decd698-1e9c-4e2d-a7c8-39d52a65c07d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.523105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5decd698-1e9c-4e2d-a7c8-39d52a65c07d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.523105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5decd698-1e9c-4e2d-a7c8-39d52a65c07d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.523105] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5decd698-1e9c-4e2d-a7c8-39d52a65c07d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.027167] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5decd698-1e9c-4e2d-a7c8-39d52a65c07d [ 1299.027167] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.027167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.027167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.027167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.027167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.027167] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5decd698-1e9c-4e2d-a7c8-39d52a65c07d already deleted. [ 1299.027167] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5decd698-1e9c-4e2d-a7c8-39d52a65c07d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.254539] env[69656]: INFO networking_nsxv3.common.synchronization [req-872c369c-25c1-46cd-967d-bc0284611273 req-d32c90ea-0483-4cb0-b7fd-f5b641c0b877 service nova] Enqueued Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGHEST for action security_group_rules [ 1299.254539] env[69656]: INFO networking_nsxv3.common.synchronization [req-872c369c-25c1-46cd-967d-bc0284611273 req-d32c90ea-0483-4cb0-b7fd-f5b641c0b877 service nova] Enqueued Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGHEST for action security_group_members [ 1299.254539] env[69656]: INFO networking_nsxv3.common.synchronization [req-872c369c-25c1-46cd-967d-bc0284611273 req-d32c90ea-0483-4cb0-b7fd-f5b641c0b877 service nova] Enqueued Resource ID: b15f114c-1515-4687-b7db-f4ddef324a4a with Priority: HIGHEST for action port [ 1299.254725] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGHEST for action security_group_rules [ 1299.254788] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGHEST for action security_group_members [ 1299.254892] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b15f114c-1515-4687-b7db-f4ddef324a4a with Priority: HIGHEST for action port [ 1299.255447] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.255769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.255769] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.255959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.255959] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbfd950d-8069-4f04-a8ec-2ff80f29dc2a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.256747] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.256852] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.256939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.257120] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.257257] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.257347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.257402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.257539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.257617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.257701] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbfd950d-8069-4f04-a8ec-2ff80f29dc2a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.258396] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-b15f114c-1515-4687-b7db-f4ddef324a4a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.258865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b15f114c-1515-4687-b7db-f4ddef324a4a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.258865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b15f114c-1515-4687-b7db-f4ddef324a4a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.259026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b15f114c-1515-4687-b7db-f4ddef324a4a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.259071] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b15f114c-1515-4687-b7db-f4ddef324a4a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.315044] env[69656]: INFO networking_nsxv3.common.synchronization [req-c05eb9ed-2fa2-47d9-9bac-0a765b2f12a0 req-3c9a0615-1674-4e4d-9568-495056879697 tempest-AttachVolumeTestJSON-2030714394 tempest-AttachVolumeTestJSON-2030714394-project-member] Enqueued Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGHEST for action security_group_members [ 1299.315540] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGHEST for action security_group_members [ 1299.315865] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-14e06840-25c7-4158-bab4-68425818e4d4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.315987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.316061] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.316267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.316671] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.316671] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.316671] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.316882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.316882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.316882] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14e06840-25c7-4158-bab4-68425818e4d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.761649] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.761869] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.762166] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbfd950d-8069-4f04-a8ec-2ff80f29dc2a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.763386] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b15f114c-1515-4687-b7db-f4ddef324a4a with status ACTIVE [ 1299.763665] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.763835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.763939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.764247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.764718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.764718] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.764865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.764963] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.765270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.765404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.765855] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.766021] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.767230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.767230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.767230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.767230] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b15f114c-1515-4687-b7db-f4ddef324a4a is going to be updated. [ 1299.788661] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.788805] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.788878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.789126] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.789266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.789426] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b15f114c-1515-4687-b7db-f4ddef324a4a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.818748] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.818946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.819062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.819361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.819486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.819752] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.819889] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.819978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.820195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.820299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.820416] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14e06840-25c7-4158-bab4-68425818e4d4 is going to be updated. [ 1299.869590] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.869748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.869822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.870298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.870298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.878598] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14e06840-25c7-4158-bab4-68425818e4d4 in Status: IN_PROGRESS for 2s [ 1300.271138] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbfd950d-8069-4f04-a8ec-2ff80f29dc2a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.706308] env[69656]: INFO networking_nsxv3.common.synchronization [None req-d1b1e9d3-682e-4aac-a60a-415693b8a82f None None] Enqueued Resource ID: 064fd211-5563-4f13-86e0-3ce63b4ac7e8 with Priority: HIGHEST for action port [ 1300.706827] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 064fd211-5563-4f13-86e0-3ce63b4ac7e8 with Priority: HIGHEST for action port [ 1300.707149] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-064fd211-5563-4f13-86e0-3ce63b4ac7e8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.707273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-064fd211-5563-4f13-86e0-3ce63b4ac7e8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.707337] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-064fd211-5563-4f13-86e0-3ce63b4ac7e8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.707597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-064fd211-5563-4f13-86e0-3ce63b4ac7e8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.707671] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('064fd211-5563-4f13-86e0-3ce63b4ac7e8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.772603] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.772884] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.773026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.773203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.773296] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.773398] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a is going to be created. [ 1300.795272] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.795464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.795464] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.795646] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.795827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.804502] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a in Status: UNINITIALIZED for 2s [ 1301.210172] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 064fd211-5563-4f13-86e0-3ce63b4ac7e8 [ 1301.210350] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.210494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.210566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.210781] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.210920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.210983] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:064fd211-5563-4f13-86e0-3ce63b4ac7e8 already deleted. [ 1301.211055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-064fd211-5563-4f13-86e0-3ce63b4ac7e8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.888854] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14e06840-25c7-4158-bab4-68425818e4d4 in Status: SUCCESS [ 1301.889182] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14e06840-25c7-4158-bab4-68425818e4d4 deletion is rescheduled due to dependency. [ 1301.889308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.386724] env[69656]: INFO networking_nsxv3.common.synchronization [req-b2894283-bc6b-450f-aad0-28d90dcdeee9 req-a3b86931-1d3b-4838-a511-48df110f93d6 tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1302.387335] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1302.388654] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.388654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.388654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.388654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.389044] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.389220] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.389379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.389580] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.389693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.390759] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.814477] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a in Status: SUCCESS [ 1302.814839] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.815087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.815327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.815541] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.815655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.815745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.815938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.816039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.816132] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.816227] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbfd950d-8069-4f04-a8ec-2ff80f29dc2a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.892629] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.176017] env[69656]: INFO networking_nsxv3.common.synchronization [None req-8a704143-8466-497d-a962-0f0a0c35dbf6 tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1303.176600] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1303.177151] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.177386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.318876] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbfd950d-8069-4f04-a8ec-2ff80f29dc2a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.395194] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.768885] env[69656]: INFO networking_nsxv3.common.synchronization [req-240106db-d3ff-454f-9531-bfe4716f43f8 req-858172ca-0d65-4867-8e58-0f2eb3985e82 tempest-ServerAddressesTestJSON-928014059 tempest-ServerAddressesTestJSON-928014059-project-member] Enqueued Resource ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f with Priority: HIGHEST for action security_group_members [ 1303.769131] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f with Priority: HIGHEST for action security_group_members [ 1303.770062] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-382cfc1d-7ee7-4358-9c83-f7c7037f435f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.770062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.770062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.770062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.770062] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.770062] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.770425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.770425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.770425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.770425] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('382cfc1d-7ee7-4358-9c83-f7c7037f435f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.821351] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbfd950d-8069-4f04-a8ec-2ff80f29dc2a: rpc.has_security_group_logging(os_id): False [ 1303.840252] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.840442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.840492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.840669] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.840875] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.840989] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.841105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.841170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.841330] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.841409] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.841494] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a is going to be created. [ 1303.897579] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.897998] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.897998] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.898152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.898375] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.899670] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.899810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.899882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.900437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.900437] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.900437] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be updated. [ 1303.912757] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a in Status: IN_PROGRESS for 2s [ 1303.940331] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.940529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.940529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.940731] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.940871] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.951539] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1304.265991] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-805 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.265991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-805" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.265991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-805" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.265991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-805" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.265991] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.265991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.265991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.265991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.265991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.266674] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1304.266833] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1304.266958] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1304.267193] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1304.267406] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1304.267583] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1304.267757] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1304.272942] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.273078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.273175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.273376] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.273501] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.273704] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.273830] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.274016] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.274210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.274316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.274420] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f already deleted. [ 1304.274522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.287549] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1304.287718] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1304.287860] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1304.288038] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-805" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.288314] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-74b79f07-07b0-4ea9-8876-f82c05fc3fd8 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.288482] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-74b79f07-07b0-4ea9-8876-f82c05fc3fd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.288606] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-74b79f07-07b0-4ea9-8876-f82c05fc3fd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.288894] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-74b79f07-07b0-4ea9-8876-f82c05fc3fd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.289063] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74b79f07-07b0-4ea9-8876-f82c05fc3fd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.793204] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.793502] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.793639] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.793935] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.794116] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.794278] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 74b79f07-07b0-4ea9-8876-f82c05fc3fd8 not found, creating... [ 1304.794565] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.794758] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.794903] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.795172] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.795315] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.795605] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.795769] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.795913] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.796166] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.796312] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.796458] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 74b79f07-07b0-4ea9-8876-f82c05fc3fd8 is going to be created. [ 1304.816567] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.816567] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.816744] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.817040] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.817347] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.817600] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-74b79f07-07b0-4ea9-8876-f82c05fc3fd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.650986] env[69656]: INFO networking_nsxv3.common.synchronization [req-240106db-d3ff-454f-9531-bfe4716f43f8 req-959dd800-3185-41d4-a537-6b88f69042f9 service nova] Enqueued Resource ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f with Priority: HIGHEST for action security_group_rules [ 1305.651375] env[69656]: INFO networking_nsxv3.common.synchronization [req-240106db-d3ff-454f-9531-bfe4716f43f8 req-959dd800-3185-41d4-a537-6b88f69042f9 service nova] Enqueued Resource ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f with Priority: HIGHEST for action security_group_members [ 1305.651375] env[69656]: INFO networking_nsxv3.common.synchronization [req-240106db-d3ff-454f-9531-bfe4716f43f8 req-959dd800-3185-41d4-a537-6b88f69042f9 service nova] Enqueued Resource ID: 74b79f07-07b0-4ea9-8876-f82c05fc3fd8 with Priority: HIGHEST for action port [ 1305.651556] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f with Priority: HIGHEST for action security_group_rules [ 1305.651699] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f with Priority: HIGHEST for action security_group_members [ 1305.651821] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74b79f07-07b0-4ea9-8876-f82c05fc3fd8 with Priority: HIGHEST for action port [ 1305.652370] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-382cfc1d-7ee7-4358-9c83-f7c7037f435f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.652499] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.652567] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.652817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.652899] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('382cfc1d-7ee7-4358-9c83-f7c7037f435f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.654414] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-382cfc1d-7ee7-4358-9c83-f7c7037f435f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.654652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.654652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.654790] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.654921] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.655025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.655098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.655222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.655348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.655408] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('382cfc1d-7ee7-4358-9c83-f7c7037f435f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.656112] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-74b79f07-07b0-4ea9-8876-f82c05fc3fd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.656302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74b79f07-07b0-4ea9-8876-f82c05fc3fd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.656302] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74b79f07-07b0-4ea9-8876-f82c05fc3fd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.656423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74b79f07-07b0-4ea9-8876-f82c05fc3fd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.656548] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74b79f07-07b0-4ea9-8876-f82c05fc3fd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.923495] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a in Status: SUCCESS [ 1305.923719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.960802] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1305.961046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.961918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.961918] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.962082] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.962082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.962191] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.962299] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.962383] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.962474] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.162850] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('382cfc1d-7ee7-4358-9c83-f7c7037f435f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.164092] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-382cfc1d-7ee7-4358-9c83-f7c7037f435f taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.164258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.164371] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74b79f07-07b0-4ea9-8876-f82c05fc3fd8 with status ACTIVE [ 1306.165242] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.165242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.165242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.165242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.165242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.165242] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.165242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.165774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.165774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.165774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.165774] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.165774] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.165961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.165994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.166536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.166672] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74b79f07-07b0-4ea9-8876-f82c05fc3fd8 is going to be updated. [ 1306.186091] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.186196] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.186236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.186420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.186555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.186715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74b79f07-07b0-4ea9-8876-f82c05fc3fd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.465523] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.465680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.465768] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.466159] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.466270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.466486] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.466593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.466658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.466833] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.466916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.467011] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be updated. [ 1306.492791] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.492960] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.493047] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.493273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.493421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.501158] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1306.668867] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('382cfc1d-7ee7-4358-9c83-f7c7037f435f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.171467] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.171621] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.171690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.171924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.172024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.172122] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f is going to be created. [ 1307.215336] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.215475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.215544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.215741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.215915] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.225108] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f in Status: UNINITIALIZED for 2s [ 1308.510167] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1308.510513] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e deletion is rescheduled due to dependency. [ 1308.510586] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.235808] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f in Status: SUCCESS [ 1309.236142] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.236407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.236650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.236874] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.237032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.237098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.237301] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.237410] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.237518] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.237627] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('382cfc1d-7ee7-4358-9c83-f7c7037f435f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.740700] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-382cfc1d-7ee7-4358-9c83-f7c7037f435f taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.740700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.740700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.740700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.741236] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.741236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.741236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.741236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.741236] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.741514] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.741514] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-382cfc1d-7ee7-4358-9c83-f7c7037f435f taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.741514] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.741697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.741697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.741806] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.741892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.741956] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.742089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.742158] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.742235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.742320] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('382cfc1d-7ee7-4358-9c83-f7c7037f435f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.244941] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 382cfc1d-7ee7-4358-9c83-f7c7037f435f: rpc.has_security_group_logging(os_id): False [ 1310.263188] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.263479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.263479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.263715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.263810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.264025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.264136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.264213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.264374] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.264451] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.264675] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.264810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.264887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.265023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.265106] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.265293] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.265398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.265457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.265599] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.265686] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.265769] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f is going to be created. [ 1310.355636] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.355968] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.355968] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.360027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.360027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.373081] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f in Status: IN_PROGRESS for 2s [ 1310.654385] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.654504] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1311.391479] env[69656]: INFO networking_nsxv3.common.synchronization [req-a2adeff6-78ac-434b-8a9d-180452f954bc req-d8610e5c-ca76-406d-9e2c-fe9aa306f5fa tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGHEST for action security_group_members [ 1311.392153] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGHEST for action security_group_members [ 1311.392710] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-40050733-791a-4246-8deb-abb95731661b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.392710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.392710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.392950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.393148] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.393250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.393312] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.393493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.393601] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.393706] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40050733-791a-4246-8deb-abb95731661b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.895651] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.895879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.895986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.896138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.896222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.896423] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.896524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.896570] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.896713] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.896782] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.896863] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40050733-791a-4246-8deb-abb95731661b is going to be updated. [ 1311.923404] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.923705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.923705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.923874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.924078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.933168] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40050733-791a-4246-8deb-abb95731661b in Status: IN_PROGRESS for 2s [ 1312.384736] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f in Status: SUCCESS [ 1312.385327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.782403] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.782752] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.782752] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.783053] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.783328] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.783492] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.783630] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.783864] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.784048] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.784263] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1312.784380] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1312.784492] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1312.784604] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1312.784725] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1312.784861] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1312.785011] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1312.810159] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1312.810333] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1312.810506] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1312.810688] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-207" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.810998] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-14e87a40-e384-4433-9219-2d25376a7a37 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.811189] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.811334] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.811662] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.811897] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e87a40-e384-4433-9219-2d25376a7a37',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.315753] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.315753] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.315753] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.315753] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.316121] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.316224] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.316387] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.316507] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.316732] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.316889] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.317192] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.317359] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.317505] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.317685] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.317822] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.317969] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 14e87a40-e384-4433-9219-2d25376a7a37 is going to be updated. [ 1313.337286] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.337502] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.337631] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.337890] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.338105] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.338328] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.944556] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40050733-791a-4246-8deb-abb95731661b in Status: SUCCESS [ 1313.944798] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40050733-791a-4246-8deb-abb95731661b deletion is rescheduled due to dependency. [ 1313.949213] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.451637] env[69656]: INFO networking_nsxv3.common.synchronization [req-57762c1b-7d7e-457b-acb3-1ec7ad353a79 req-de3ba390-0a93-4db2-adf0-ddda78316a0c service nova] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_rules [ 1314.451637] env[69656]: INFO networking_nsxv3.common.synchronization [req-57762c1b-7d7e-457b-acb3-1ec7ad353a79 req-de3ba390-0a93-4db2-adf0-ddda78316a0c service nova] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1314.451637] env[69656]: INFO networking_nsxv3.common.synchronization [req-57762c1b-7d7e-457b-acb3-1ec7ad353a79 req-de3ba390-0a93-4db2-adf0-ddda78316a0c service nova] Enqueued Resource ID: 14e87a40-e384-4433-9219-2d25376a7a37 with Priority: HIGHEST for action port [ 1314.451776] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_rules [ 1314.451989] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1314.451989] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e87a40-e384-4433-9219-2d25376a7a37 with Priority: HIGHEST for action port [ 1314.452604] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.452754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.452853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.453390] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.453490] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.454604] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.454710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.454710] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.455065] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.455161] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.455257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.455397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.455506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.455611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.455738] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.456745] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-14e87a40-e384-4433-9219-2d25376a7a37 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.456913] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.457182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.457706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.457706] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e87a40-e384-4433-9219-2d25376a7a37',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.959709] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.960121] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.960250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.961118] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14e87a40-e384-4433-9219-2d25376a7a37 with status ACTIVE [ 1314.961118] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.961118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.961118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.961118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.961444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.961444] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.961527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.961527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.961679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.961737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.961907] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.962008] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.962068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.962252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.962315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.962361] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14e87a40-e384-4433-9219-2d25376a7a37 is going to be updated. [ 1314.985427] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.985609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.985718] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.985863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.986049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.986346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14e87a40-e384-4433-9219-2d25376a7a37" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.461926] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.645032] env[69656]: INFO networking_nsxv3.common.synchronization [req-5b7728e0-ee3e-40ad-a308-8858c0f2dfef req-331518ea-0b7a-4d53-b35f-2a687810a786 tempest-ServerAddressesTestJSON-928014059 tempest-ServerAddressesTestJSON-928014059-project-member] Enqueued Resource ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f with Priority: HIGHEST for action security_group_members [ 1315.645032] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f with Priority: HIGHEST for action security_group_members [ 1315.645032] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-382cfc1d-7ee7-4358-9c83-f7c7037f435f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.645032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.645232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.645267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.645426] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.645521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.645582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.645721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.645801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.645986] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('382cfc1d-7ee7-4358-9c83-f7c7037f435f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.964140] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.964690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.964690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.964690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.964690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.965029] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be updated. [ 1315.991015] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.991203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.991288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.991525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.991752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.001165] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: IN_PROGRESS for 2s [ 1316.149819] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.150072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.150072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.150400] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.150520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.150676] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.150785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.150863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.151064] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.151160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.151268] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f is going to be updated. [ 1316.184087] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.184087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.184087] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.184249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.184381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.193609] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f in Status: IN_PROGRESS for 2s [ 1316.352652] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f0be65fd-64d4-4ee2-b694-506327af1d0d tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_rules [ 1316.353311] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_rules [ 1316.353622] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.353746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.353839] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.354305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.354432] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.499599] env[69656]: INFO networking_nsxv3.common.synchronization [None req-f7d2f623-c6c9-4cab-82a1-2e441215ae80 tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_rules [ 1316.500676] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_rules [ 1316.500676] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.500676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.878959] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.879137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.879207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.879422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.879516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.879610] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 781f4608-514f-4c7d-a344-49d690a18ab7 already deleted. [ 1316.879701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.879845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.880008] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.880109] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.401444] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.402701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.402807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.403119] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.403255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.403358] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 781f4608-514f-4c7d-a344-49d690a18ab7 already deleted. [ 1317.403456] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.011261] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: SUCCESS [ 1318.011261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.011492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.011576] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.011746] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.011865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.011942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.012097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.012181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.012279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.012371] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.202806] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f in Status: SUCCESS [ 1318.203032] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f deletion is rescheduled due to dependency. [ 1318.203032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.514603] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.016766] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ed397b9-8a6a-442e-a200-45439f9f86d9: rpc.has_security_group_logging(os_id): False [ 1319.034167] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.034390] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.034390] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.034605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.034682] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.034974] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.035136] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.035182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.035307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.035384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.035471] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be updated. [ 1319.094454] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.094659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.094659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.094849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.095060] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.106684] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: IN_PROGRESS for 2s [ 1321.120925] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: SUCCESS [ 1321.120925] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.501417] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1321.501622] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1322.079054] env[69656]: INFO networking_nsxv3.common.synchronization [req-3d516f1f-93c1-4ef5-b37e-0b6b12127b85 req-4ef3198d-c1a1-43ee-9e69-9b3e658e5aa4 tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_members [ 1322.079641] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_members [ 1322.080052] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.080195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.080195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.080432] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.080611] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.080737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.080801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.080963] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.081055] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.081190] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.450329] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.450758] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.450758] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.450990] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.451268] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.451429] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.451604] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.451835] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.452044] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.452245] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1322.452420] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1322.452484] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1322.452562] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1322.452735] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1322.452856] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1322.453017] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1322.470433] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1322.470609] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1322.470656] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1322.470822] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.471167] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-12d42e9a-31ee-43fe-bd06-4980494440b6 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.471410] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-12d42e9a-31ee-43fe-bd06-4980494440b6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.471540] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-12d42e9a-31ee-43fe-bd06-4980494440b6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.471867] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-12d42e9a-31ee-43fe-bd06-4980494440b6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.472027] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12d42e9a-31ee-43fe-bd06-4980494440b6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.583876] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.584215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.584215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.584445] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.584543] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.584757] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.585232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.585232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.585232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.585232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.585494] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 781f4608-514f-4c7d-a344-49d690a18ab7 already deleted. [ 1322.585494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.974452] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.974676] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.974754] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.975173] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.975352] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.975522] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 12d42e9a-31ee-43fe-bd06-4980494440b6 not found, creating... [ 1322.975804] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.975972] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.976114] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.976353] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.976498] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.976792] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.976957] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.977095] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.977313] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.977483] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.977599] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 12d42e9a-31ee-43fe-bd06-4980494440b6 is going to be created. [ 1322.997413] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.997664] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.997770] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.998068] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.998400] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.998645] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-12d42e9a-31ee-43fe-bd06-4980494440b6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.692927] env[69656]: INFO networking_nsxv3.common.synchronization [req-3d516f1f-93c1-4ef5-b37e-0b6b12127b85 req-5e44f6cf-2983-4c39-8d77-8f67dd68d184 service nova] Enqueued Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_rules [ 1323.693211] env[69656]: INFO networking_nsxv3.common.synchronization [req-3d516f1f-93c1-4ef5-b37e-0b6b12127b85 req-5e44f6cf-2983-4c39-8d77-8f67dd68d184 service nova] Enqueued Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_members [ 1323.693353] env[69656]: INFO networking_nsxv3.common.synchronization [req-3d516f1f-93c1-4ef5-b37e-0b6b12127b85 req-5e44f6cf-2983-4c39-8d77-8f67dd68d184 service nova] Enqueued Resource ID: 12d42e9a-31ee-43fe-bd06-4980494440b6 with Priority: HIGHEST for action port [ 1323.693600] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_rules [ 1323.693740] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_members [ 1323.693840] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12d42e9a-31ee-43fe-bd06-4980494440b6 with Priority: HIGHEST for action port [ 1323.694594] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.694728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.694807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.695074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.695165] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.696010] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.696149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.696223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.696415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.696592] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.696683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.696759] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.697050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.697050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.697160] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.699292] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-12d42e9a-31ee-43fe-bd06-4980494440b6 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.699553] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12d42e9a-31ee-43fe-bd06-4980494440b6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.699645] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12d42e9a-31ee-43fe-bd06-4980494440b6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.699834] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12d42e9a-31ee-43fe-bd06-4980494440b6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.699924] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12d42e9a-31ee-43fe-bd06-4980494440b6',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.202336] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.202476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.202667] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12d42e9a-31ee-43fe-bd06-4980494440b6 with status ACTIVE [ 1324.202904] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.203033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.203110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.203303] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.203392] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.203563] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.203656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.203709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.203862] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.203939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.204130] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.204225] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.204278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.204421] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.204492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.204587] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12d42e9a-31ee-43fe-bd06-4980494440b6 is going to be updated. [ 1324.205746] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.227977] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.228113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.228160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.228323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.228450] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.228598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12d42e9a-31ee-43fe-bd06-4980494440b6" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.708319] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.211130] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.211406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.211406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.211582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.211675] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.211775] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 781f4608-514f-4c7d-a344-49d690a18ab7 is going to be created. [ 1325.236339] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.236583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.236583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.236715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.236876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.246403] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: UNINITIALIZED for 2s [ 1326.705729] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.706269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.706269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.706269] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.706477] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.761063] env[69656]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1326.761204] env[69656]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1327.209345] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.258730] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: SUCCESS [ 1327.258954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.259153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.259444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.259664] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.259787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.259864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.260100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.260217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.260313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.260406] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.712222] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.762108] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.214940] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1328.215211] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1328.264677] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 781f4608-514f-4c7d-a344-49d690a18ab7: rpc.has_security_group_logging(os_id): False [ 1328.281095] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.281335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.281335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.281530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.281617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.281860] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.281961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.282036] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.282198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.282276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.282359] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 781f4608-514f-4c7d-a344-49d690a18ab7 is going to be created. [ 1328.345643] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.345894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.345894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.346064] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.346262] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.356419] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: IN_PROGRESS for 2s [ 1328.694621] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1328.694788] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1329.037337] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.037696] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.037696] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.037804] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.052081] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1329.052870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.053613] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1329.093583] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.093733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.093854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.094091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.108917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.109696] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1329.109774] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1329.109864] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1329.170703] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.171098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.171210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.171523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.174308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.174605] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1329.260995] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.261220] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.261308] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.261494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.261861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.262237] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1329.338929] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.339162] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.339162] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.339680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.339779] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.340269] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1329.340477] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'382cfc1d-7ee7-4358-9c83-f7c7037f435f', '0ed397b9-8a6a-442e-a200-45439f9f86d9', 'c0b372e3-dc4f-48b1-9e79-f3de5b63e563', '781f4608-514f-4c7d-a344-49d690a18ab7', '14e06840-25c7-4158-bab4-68425818e4d4', '10987214-e215-44cd-98d2-5bd627e6c0e2', '40050733-791a-4246-8deb-abb95731661b', 'fc5eb60b-e0f7-414b-a660-add25da9efa7', '6c40e462-de5f-44fc-812b-8caf1dff4c9e', 'ceadc5a6-0e5a-4475-96ab-3f4a1cec315b', 'a5f15371-c02b-43e4-b8a5-670ce8c4b232', '7b0f9291-4852-4d43-9155-e275aacce00d', '457b4cc0-32ad-4db2-819d-1a58cf1de954', 'e7af54d8-7472-45f1-aeff-b4e7f22e3f8a', '520db785-680d-4180-b916-bfbc19204d31', '48b4d26b-dd71-400b-9bfe-8da7699695a9', '9732c8f9-8304-4af7-9c52-c3d19cdecc90', 'fb962a91-1fd6-476a-900f-fb50bdf4b147', '7976f89e-e748-4aab-bd17-3b945c409c8c', '759da36a-a18b-4f5f-b889-a6d7444033f4', '38729b4b-23ae-4e26-b524-9c3d018d87eb', '6d9740de-f67c-4fbd-a249-44afc4caaef1', 'e7c27843-e365-4bd4-9103-dc94b0c2a637', '06966f07-554f-446e-a2a7-17a62c52a519', '3746f1b2-61cd-415b-a74b-1d4da3f9731f', '841baacb-db1a-4155-8c56-e0d487b1795b', '012722d0-145e-4c53-8203-3606845f8f43', '3274dea2-eaf7-4169-ba91-1154eac58032', '792b043f-2560-4918-890f-99f50b059db4', 'fbfd950d-8069-4f04-a8ec-2ff80f29dc2a', '0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b', 'c35bc1ec-d02e-41f7-b05b-c27e0d977c43', '037b783b-a9e4-4669-8461-2452a42615e1', 'fe7fb2d8-2929-4f36-a2da-bafb532a875d', '3a714e7c-1123-47f3-81e4-70f097603f3e', '5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8', '77d2c3a5-526e-400a-8792-5423d2e6c534', '8e938057-3189-4358-8ca5-5e18d05bbddf', 'd70c367d-ca7b-45b3-9579-5b05739f400a', '4a133f47-cf05-42f1-8365-6a566b72e14d', '1d9405cd-478a-474f-af17-55246ce5acfa', 'a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf', 'f3521005-0bf3-4791-8930-fe6bb6c94423', 'a0e73dee-afe4-4a44-9672-c68cc0af0557', '8a9ee1b5-46c4-4ea5-a724-f697a2014dcb'} {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1329.340477] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1329.363129] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.363129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.363129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.363129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.363129] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.363129] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1329.363129] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1329.363129] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1329.439590] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.439785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.439865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.440138] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.441483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.441883] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1329.441968] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1329.442046] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1329.442155] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1329.442233] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1329.442335] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f with Priority: HIGH for action security_group_rules [ 1329.442377] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGH for action security_group_rules [ 1329.442441] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGH for action security_group_rules [ 1329.442536] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGH for action security_group_rules [ 1329.442578] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGH for action security_group_rules [ 1329.442620] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGH for action security_group_rules [ 1329.442674] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGH for action security_group_rules [ 1329.442732] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGH for action security_group_rules [ 1329.442833] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGH for action security_group_rules [ 1329.442876] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGH for action security_group_rules [ 1329.443013] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGH for action security_group_rules [ 1329.443172] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGH for action security_group_rules [ 1329.443235] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGH for action security_group_rules [ 1329.443293] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGH for action security_group_rules [ 1329.443370] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGH for action security_group_rules [ 1329.443416] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 with Priority: HIGH for action security_group_rules [ 1329.443479] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGH for action security_group_rules [ 1329.443575] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGH for action security_group_rules [ 1329.443641] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGH for action security_group_rules [ 1329.443700] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 with Priority: HIGH for action security_group_rules [ 1329.443827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.369835] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: SUCCESS [ 1330.370107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.763061] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-152 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.763381] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.763428] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.763674] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.763949] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.764125] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.764246] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.764466] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.764612] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.764818] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1331.764935] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1331.765079] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1331.765230] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1331.765362] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1331.765477] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1331.765615] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1331.782919] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1331.783084] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1331.783225] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1331.783461] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-152" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.783749] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-9b086c0a-326a-415b-88a9-4022668f9f15 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.783916] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.784052] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.784285] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.784422] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b086c0a-326a-415b-88a9-4022668f9f15',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.286179] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.286410] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.286542] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.286815] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.286978] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.287280] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.287445] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.287568] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.287812] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.287928] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.288239] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.288401] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.288522] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.288726] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.288858] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.289013] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 9b086c0a-326a-415b-88a9-4022668f9f15 is going to be updated. [ 1332.310695] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.310899] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.311143] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.311461] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.311679] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.311904] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.462280] env[69656]: INFO networking_nsxv3.common.synchronization [req-3e73a111-4bb0-48aa-88ef-fd7b2367d65a req-bcb9a7bf-9cb6-4f62-88b7-59e7e224613f tempest-ServerActionsTestOtherB-109014868 tempest-ServerActionsTestOtherB-109014868-project-member] Enqueued Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1332.463601] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGHEST for action security_group_members [ 1332.463601] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f with Priority: HIGH for action security_group_rules [ 1332.463747] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 with Priority: HIGH for action security_group_rules [ 1332.463747] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40050733-791a-4246-8deb-abb95731661b with Priority: HIGH for action security_group_rules [ 1332.463828] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 520db785-680d-4180-b916-bfbc19204d31 with Priority: HIGH for action security_group_rules [ 1332.463932] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 with Priority: HIGH for action security_group_rules [ 1332.464016] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7976f89e-e748-4aab-bd17-3b945c409c8c with Priority: HIGH for action security_group_rules [ 1332.464111] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 with Priority: HIGH for action security_group_rules [ 1332.464227] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 with Priority: HIGH for action security_group_rules [ 1332.464290] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a with Priority: HIGH for action security_group_rules [ 1332.464388] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 with Priority: HIGH for action security_group_rules [ 1332.464483] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 with Priority: HIGH for action security_group_rules [ 1332.464563] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGH for action security_group_rules [ 1332.464650] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGH for action security_group_rules [ 1332.464737] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b with Priority: HIGH for action security_group_rules [ 1332.464882] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGH for action security_group_rules [ 1332.464944] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 with Priority: HIGH for action security_group_rules [ 1332.465100] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 with Priority: HIGH for action security_group_rules [ 1332.465512] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e06840-25c7-4158-bab4-68425818e4d4 with Priority: HIGH for action security_group_rules [ 1332.465512] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 with Priority: HIGH for action security_group_rules [ 1332.465512] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGH for action security_group_rules [ 1332.465747] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.465835] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.465978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.466162] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.466321] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.466453] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.466506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.466655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.466746] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.466838] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.467683] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-382cfc1d-7ee7-4358-9c83-f7c7037f435f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.467789] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.467856] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.468039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.471018] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('382cfc1d-7ee7-4358-9c83-f7c7037f435f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.471018] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.471018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.471018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.471018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.471018] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0b372e3-dc4f-48b1-9e79-f3de5b63e563',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.471018] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40050733-791a-4246-8deb-abb95731661b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.471018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.471018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.471018] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.471018] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40050733-791a-4246-8deb-abb95731661b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.471691] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-520db785-680d-4180-b916-bfbc19204d31 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.471691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.471691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.471691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.471691] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('520db785-680d-4180-b916-bfbc19204d31',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.472423] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-759da36a-a18b-4f5f-b889-a6d7444033f4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.472504] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.472504] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.472722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.472785] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('759da36a-a18b-4f5f-b889-a6d7444033f4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.473600] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7976f89e-e748-4aab-bd17-3b945c409c8c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.473600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.473745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.473792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.473849] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7976f89e-e748-4aab-bd17-3b945c409c8c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.474671] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb962a91-1fd6-476a-900f-fb50bdf4b147 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.474841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.474841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.474964] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.475044] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb962a91-1fd6-476a-900f-fb50bdf4b147',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.475745] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.475854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.475901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.476022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.476091] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9732c8f9-8304-4af7-9c52-c3d19cdecc90',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.476731] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.476827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.476890] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.477094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.477218] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7af54d8-7472-45f1-aeff-b4e7f22e3f8a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.477814] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48b4d26b-dd71-400b-9bfe-8da7699695a9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.477906] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.478080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.478144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.478222] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48b4d26b-dd71-400b-9bfe-8da7699695a9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.480783] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-457b4cc0-32ad-4db2-819d-1a58cf1de954 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.480894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.480938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.481107] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.481185] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('457b4cc0-32ad-4db2-819d-1a58cf1de954',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.481861] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b0f9291-4852-4d43-9155-e275aacce00d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.482022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.484131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.484131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.484131] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b0f9291-4852-4d43-9155-e275aacce00d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.484437] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.484527] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.484654] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.484747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.484833] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.485605] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.485931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.486028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.487664] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.487664] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ceadc5a6-0e5a-4475-96ab-3f4a1cec315b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.487664] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.487664] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.487664] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.487664] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.487664] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.488875] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10987214-e215-44cd-98d2-5bd627e6c0e2 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.488875] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.488875] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.488875] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.489081] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10987214-e215-44cd-98d2-5bd627e6c0e2',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.489613] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc5eb60b-e0f7-414b-a660-add25da9efa7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.489728] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.489831] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.489944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.490025] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc5eb60b-e0f7-414b-a660-add25da9efa7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.491236] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14e06840-25c7-4158-bab4-68425818e4d4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.491521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.491606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.491745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.491816] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14e06840-25c7-4158-bab4-68425818e4d4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.492563] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ed397b9-8a6a-442e-a200-45439f9f86d9 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.492657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.492724] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.492976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.493065] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ed397b9-8a6a-442e-a200-45439f9f86d9',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.493790] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.493876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.493946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.494128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.494204] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.519298] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.519448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.519492] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.519705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.521935] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.522046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.544980] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.545188] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 520db785-680d-4180-b916-bfbc19204d31 is going to be deleted. [ 1332.546326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.546566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.583174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.583393] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 759da36a-a18b-4f5f-b889-a6d7444033f4 is going to be deleted. [ 1332.617761] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.618637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.618637] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.619182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.619182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.619182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-520db785-680d-4180-b916-bfbc19204d31" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.633040] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.633233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.633277] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.633703] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.633703] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.633703] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-759da36a-a18b-4f5f-b889-a6d7444033f4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.013233] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.013233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.013233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.013233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.016780] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0f9291-4852-4d43-9155-e275aacce00d taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.017181] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.020017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.020017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.020017] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.020017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.020017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.020017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.020017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.020017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.020017] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b0f9291-4852-4d43-9155-e275aacce00d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.020017] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.020017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.020017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.020017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.020881] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.021270] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.021461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.021732] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.021975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.022210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.022433] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.039583] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.039912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.085294] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.085294] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.088117] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.088117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.088117] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.088117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.091065] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.091186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.091891] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.091999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.092711] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.092809] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.093651] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.093771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.094506] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.094609] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.095401] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.095493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.096420] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1333.100020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.100020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.100020] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1333.100020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.100020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.100020] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1333.100020] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.100020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.101474] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1333.101474] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.101474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.101474] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1333.104233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.104233] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.104233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.104233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.104233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.104233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.104233] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be updated. [ 1333.105148] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.105257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.105340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.105523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.107084] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.107200] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.130254] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1333.130762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.130904] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be deleted. [ 1333.131828] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.131987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.142140] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.142287] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.142355] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.145446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.145446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.151664] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: IN_PROGRESS for 2s [ 1333.156118] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.156243] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7976f89e-e748-4aab-bd17-3b945c409c8c is going to be deleted. [ 1333.159209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.160606] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.183357] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.183357] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.192017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.192017] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc5eb60b-e0f7-414b-a660-add25da9efa7 is going to be deleted. [ 1333.192017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.192017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.215876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.216018] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 457b4cc0-32ad-4db2-819d-1a58cf1de954 is going to be deleted. [ 1333.216876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.217110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.240370] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.240572] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.245826] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.246073] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0b372e3-dc4f-48b1-9e79-f3de5b63e563 is going to be deleted. [ 1333.246961] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.247189] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.247281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.247416] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 is going to be deleted. [ 1333.248180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.248349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.273838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.273966] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10987214-e215-44cd-98d2-5bd627e6c0e2 is going to be deleted. [ 1333.277341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.277341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.287882] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.288024] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.322068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.322204] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14e06840-25c7-4158-bab4-68425818e4d4 is going to be deleted. [ 1333.323393] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.323600] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.352177] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.352306] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.381864] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.382052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.422216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.422352] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 382cfc1d-7ee7-4358-9c83-f7c7037f435f is going to be deleted. [ 1333.423259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.423469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.429032] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.429140] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.522234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.522394] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48b4d26b-dd71-400b-9bfe-8da7699695a9 is going to be deleted. [ 1333.523427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.523627] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.533364] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b0f9291-4852-4d43-9155-e275aacce00d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.540995] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.596379] env[69656]: INFO networking_nsxv3.common.synchronization [req-f4f9f3e0-59db-4436-bd4b-fae40ce8c958 req-560e2da2-32f2-4add-a280-11e4632764c2 service nova] Enqueued Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_rules [ 1333.596574] env[69656]: INFO networking_nsxv3.common.synchronization [req-f4f9f3e0-59db-4436-bd4b-fae40ce8c958 req-560e2da2-32f2-4add-a280-11e4632764c2 service nova] Enqueued Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_members [ 1333.596747] env[69656]: INFO networking_nsxv3.common.synchronization [req-f4f9f3e0-59db-4436-bd4b-fae40ce8c958 req-560e2da2-32f2-4add-a280-11e4632764c2 service nova] Enqueued Resource ID: 9b086c0a-326a-415b-88a9-4022668f9f15 with Priority: HIGHEST for action port [ 1333.597233] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_rules [ 1333.597375] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_members [ 1333.597470] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b086c0a-326a-415b-88a9-4022668f9f15 with Priority: HIGHEST for action port [ 1333.597795] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.597849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.598027] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5f15371-c02b-43e4-b8a5-670ce8c4b232 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.598156] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.598198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.598388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.598536] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.598628] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.598688] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.598827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.598912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.599009] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.602130] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b086c0a-326a-415b-88a9-4022668f9f15 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.602130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.602130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.602130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.602130] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b086c0a-326a-415b-88a9-4022668f9f15',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.618025] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.618025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.618025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.618025] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ceadc5a6-0e5a-4475-96ab-3f4a1cec315b is going to be deleted. [ 1333.618025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.618025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.619108] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.619198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.640476] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.640660] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.666656] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.666811] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.688653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.688778] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40050733-791a-4246-8deb-abb95731661b is going to be deleted. [ 1333.689664] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.689878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.718778] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.718942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.719716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.719819] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9732c8f9-8304-4af7-9c52-c3d19cdecc90 is going to be deleted. [ 1333.720568] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.720764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.743491] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.743613] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7af54d8-7472-45f1-aeff-b4e7f22e3f8a is going to be deleted. [ 1333.744379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.744575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.804218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.804359] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 is going to be deleted. [ 1333.805190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.805384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.850966] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.851116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.867969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.868124] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb962a91-1fd6-476a-900f-fb50bdf4b147 is going to be deleted. [ 1333.868993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.869216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.869307] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.869425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.869577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.869730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.869808] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.869921] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7976f89e-e748-4aab-bd17-3b945c409c8c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.870376] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.870542] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.870624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.870743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc5eb60b-e0f7-414b-a660-add25da9efa7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.870868] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.871014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.871579] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.871705] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-457b4cc0-32ad-4db2-819d-1a58cf1de954" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.871836] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.871984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.872075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.872193] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.872316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.872457] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.872531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.872636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0b372e3-dc4f-48b1-9e79-f3de5b63e563" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.872757] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.872893] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.872968] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.873084] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10987214-e215-44cd-98d2-5bd627e6c0e2" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.873203] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.873338] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.873411] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.873515] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14e06840-25c7-4158-bab4-68425818e4d4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.873632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.873766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.873839] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.873944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-382cfc1d-7ee7-4358-9c83-f7c7037f435f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.874074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.874212] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.874284] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.874388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48b4d26b-dd71-400b-9bfe-8da7699695a9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.874504] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.874636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.874708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.874810] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ceadc5a6-0e5a-4475-96ab-3f4a1cec315b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.874927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.875128] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.875202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.875309] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9732c8f9-8304-4af7-9c52-c3d19cdecc90" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.881670] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.881848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.881914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.882078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.882155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.882272] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40050733-791a-4246-8deb-abb95731661b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.913184] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.913184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.913184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.913184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.913184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.913461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7af54d8-7472-45f1-aeff-b4e7f22e3f8a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.984697] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.984697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.984697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.984952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.984952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.984952] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.985150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.985589] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.985589] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.989468] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1333.989948] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.990094] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.990150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.990334] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.990422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.990553] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb962a91-1fd6-476a-900f-fb50bdf4b147" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.037520] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b0f9291-4852-4d43-9155-e275aacce00d: rpc.has_security_group_logging(os_id): False [ 1334.043385] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 781f4608-514f-4c7d-a344-49d690a18ab7: rpc.has_security_group_logging(os_id): False [ 1334.077076] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.077232] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.077276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.077481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.078971] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.079077] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.101731] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.102613] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b086c0a-326a-415b-88a9-4022668f9f15 with status ACTIVE [ 1334.102801] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.102932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.103052] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.103256] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.103345] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.103573] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.103679] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.103737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.103892] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.103969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.104163] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.104261] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.104335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.104760] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.104760] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.104760] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b086c0a-326a-415b-88a9-4022668f9f15 is going to be updated. [ 1334.134192] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.134482] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.134581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.134639] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.135105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.135105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.135105] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b0f9291-4852-4d43-9155-e275aacce00d is going to be updated. [ 1334.136086] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.136282] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.164681] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.164812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.164916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.165169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.165313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.165471] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b086c0a-326a-415b-88a9-4022668f9f15" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.174164] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.174422] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.174670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.174670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.174771] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.174880] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.174931] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 781f4608-514f-4c7d-a344-49d690a18ab7 is going to be updated. [ 1334.294570] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.294721] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.294792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.295020] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.295233] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.314608] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0f9291-4852-4d43-9155-e275aacce00d in Status: IN_PROGRESS for 2s [ 1334.327235] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.327390] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.327446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.327659] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.327801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.358383] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: IN_PROGRESS for 2s [ 1334.487667] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5f15371-c02b-43e4-b8a5-670ce8c4b232 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.487744] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.606915] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.110451] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.110846] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.110846] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.110846] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.110954] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.111173] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 is going to be updated. [ 1335.137953] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.138134] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.138198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.138408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.138551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.150106] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 in Status: IN_PROGRESS for 2s [ 1335.158138] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 in Status: SUCCESS [ 1335.158371] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed397b9-8a6a-442e-a200-45439f9f86d9 deletion is rescheduled due to dependency. [ 1335.158463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed397b9-8a6a-442e-a200-45439f9f86d9" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.326255] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0f9291-4852-4d43-9155-e275aacce00d in Status: SUCCESS [ 1336.326532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.369713] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: SUCCESS [ 1336.369713] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.161670] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 in Status: SUCCESS [ 1337.161885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.162056] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.162267] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.162454] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.162571] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.162635] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.162783] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.162861] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.162945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.163044] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.665557] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.168319] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5f15371-c02b-43e4-b8a5-670ce8c4b232: rpc.has_security_group_logging(os_id): False [ 1338.187242] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.187242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.187242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.187242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.187559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.189048] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.189048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.189048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.189048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.189048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.189048] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 is going to be created. [ 1338.244720] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.244983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.244983] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.245268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.245495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.255955] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 in Status: IN_PROGRESS for 2s [ 1338.597951] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.598070] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1340.270150] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 in Status: SUCCESS [ 1340.270448] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.690120] env[69656]: INFO networking_nsxv3.common.synchronization [req-2cdada5e-0d41-4118-a44c-86dc415d0420 req-fd73d815-e8d7-4b2b-8731-bfe7d103949f tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_members [ 1341.690727] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_members [ 1341.691068] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.691199] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.691265] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.691470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.692057] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.692161] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.692161] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.692288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.692373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.692471] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.997662] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.997878] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.997991] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.998280] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.998536] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.998701] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.998822] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.999045] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.999196] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.999413] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1341.999525] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1341.999638] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1341.999750] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1341.999862] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1342.000010] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1342.000108] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1342.017952] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1342.019261] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1342.019261] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1342.019261] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.019261] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-04920a98-21b4-4eea-be66-4051c7d7abdd taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.019261] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-04920a98-21b4-4eea-be66-4051c7d7abdd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.019261] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-04920a98-21b4-4eea-be66-4051c7d7abdd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.019622] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-04920a98-21b4-4eea-be66-4051c7d7abdd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.019622] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04920a98-21b4-4eea-be66-4051c7d7abdd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.194192] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.522202] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.522457] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.522590] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.522899] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.523078] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.523243] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 04920a98-21b4-4eea-be66-4051c7d7abdd not found, creating... [ 1342.523533] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.523698] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.523818] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.524057] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.524200] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.524486] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.524645] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.524764] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.524973] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.525201] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.525346] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 04920a98-21b4-4eea-be66-4051c7d7abdd is going to be created. [ 1342.544599] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.544859] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.545092] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.545429] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.545831] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.546108] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-04920a98-21b4-4eea-be66-4051c7d7abdd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.697438] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.200590] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.200806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.200806] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.201068] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.201188] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.201235] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 781f4608-514f-4c7d-a344-49d690a18ab7 is going to be updated. [ 1343.229957] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.230139] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.230215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.230489] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.230647] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.235910] env[69656]: INFO networking_nsxv3.common.synchronization [req-2cdada5e-0d41-4118-a44c-86dc415d0420 req-b897fce7-0a31-4d8b-bc29-c4c321704672 service nova] Enqueued Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_rules [ 1343.236103] env[69656]: INFO networking_nsxv3.common.synchronization [req-2cdada5e-0d41-4118-a44c-86dc415d0420 req-b897fce7-0a31-4d8b-bc29-c4c321704672 service nova] Enqueued Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_members [ 1343.236333] env[69656]: INFO networking_nsxv3.common.synchronization [req-2cdada5e-0d41-4118-a44c-86dc415d0420 req-b897fce7-0a31-4d8b-bc29-c4c321704672 service nova] Enqueued Resource ID: 04920a98-21b4-4eea-be66-4051c7d7abdd with Priority: HIGHEST for action port [ 1343.236799] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_rules [ 1343.236924] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_members [ 1343.237072] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04920a98-21b4-4eea-be66-4051c7d7abdd with Priority: HIGHEST for action port [ 1343.237339] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.237483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.237536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.237717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.237809] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.239238] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.239334] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.239558] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-04920a98-21b4-4eea-be66-4051c7d7abdd taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.239867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04920a98-21b4-4eea-be66-4051c7d7abdd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.239867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04920a98-21b4-4eea-be66-4051c7d7abdd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.239867] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04920a98-21b4-4eea-be66-4051c7d7abdd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.239972] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04920a98-21b4-4eea-be66-4051c7d7abdd',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.241955] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: IN_PROGRESS for 2s [ 1343.739836] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.740180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.742417] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04920a98-21b4-4eea-be66-4051c7d7abdd with status ACTIVE [ 1343.742647] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.742782] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.742854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.743098] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.743227] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.743424] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.743529] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.743582] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.744091] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.744231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.744449] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.744554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.744619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.744785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.744863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.744952] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04920a98-21b4-4eea-be66-4051c7d7abdd is going to be updated. [ 1343.765963] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.766215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.766215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.766395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.766536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.766697] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04920a98-21b4-4eea-be66-4051c7d7abdd" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.251687] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: SUCCESS [ 1345.252126] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.252204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.252465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.252706] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.252847] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.252910] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.253169] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.253268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.253373] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.756130] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.258834] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.761068] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.761297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.761297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.761484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.761575] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.761673] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 781f4608-514f-4c7d-a344-49d690a18ab7 is going to be updated. [ 1346.791541] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.791719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.791719] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.791853] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.791988] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.799921] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: IN_PROGRESS for 2s [ 1347.824450] env[69656]: INFO networking_nsxv3.common.synchronization [req-074f9697-ba76-48bc-80ce-836f83bcad8a req-ce3439a4-46f1-45e0-9027-5018f2ad62ca tempest-AttachVolumeNegativeTest-908987488 tempest-AttachVolumeNegativeTest-908987488-project-member] Enqueued Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGHEST for action security_group_members [ 1347.824832] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0f9291-4852-4d43-9155-e275aacce00d with Priority: HIGHEST for action security_group_members [ 1347.825299] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0f9291-4852-4d43-9155-e275aacce00d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.825407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.825407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.826038] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.826038] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.826038] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.826038] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.826276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.826276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.826493] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0f9291-4852-4d43-9155-e275aacce00d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.328411] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.328607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.328663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.328851] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.328942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.329150] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.329250] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.329315] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.329467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.329545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.329629] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0f9291-4852-4d43-9155-e275aacce00d is going to be updated. [ 1348.356807] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.356997] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.356997] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.357144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.357313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.435263] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0f9291-4852-4d43-9155-e275aacce00d in Status: IN_PROGRESS for 2s [ 1348.821329] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: SUCCESS [ 1348.821612] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.821807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.822074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.822308] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.822462] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.822532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.822726] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.822821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.822940] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.823057] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.325604] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.828166] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 781f4608-514f-4c7d-a344-49d690a18ab7: rpc.has_security_group_logging(os_id): False [ 1349.851711] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.851936] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.851984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.852320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.852479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.852832] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.853066] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.853174] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.853379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.853470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.853559] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 781f4608-514f-4c7d-a344-49d690a18ab7 is going to be updated. [ 1349.917658] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.917886] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.917934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.918172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.918349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.932949] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: IN_PROGRESS for 2s [ 1350.445349] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0f9291-4852-4d43-9155-e275aacce00d in Status: SUCCESS [ 1350.445849] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0f9291-4852-4d43-9155-e275aacce00d deletion is rescheduled due to dependency. [ 1350.445849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0f9291-4852-4d43-9155-e275aacce00d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.581053] env[69656]: INFO networking_nsxv3.common.synchronization [None req-b4510d8c-f0ef-4823-9ea5-d83cff975241 tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1351.581053] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1351.581053] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.581053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.581053] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.581655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.581655] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.581655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.581655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.581655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.581872] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.581872] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.948554] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: SUCCESS [ 1351.948795] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.085366] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.085551] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.085624] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.085841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.085934] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.086155] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.086310] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.086396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.086569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.086649] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.086738] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be deleted. [ 1352.113338] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.113516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.113560] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.113734] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.113820] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.113916] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.344984] env[69656]: INFO networking_nsxv3.common.synchronization [req-dc49f9ad-bff1-4775-a7e8-81508b97da2e req-47710ee8-41d5-415a-ba29-ef0f1a5b51cb tempest-ServerActionsV293TestJSON-1538650303 tempest-ServerActionsV293TestJSON-1538650303-project-member] Enqueued Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGHEST for action security_group_members [ 1354.346195] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGHEST for action security_group_members [ 1354.346195] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.346195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.346195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.346562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.346562] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.346562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.346562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.346714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.346793] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.346886] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbfd950d-8069-4f04-a8ec-2ff80f29dc2a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.848925] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.849081] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.849200] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.849362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.872520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.872828] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.872928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.872976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.873160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.873244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.873366] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a is going to be updated. [ 1354.898333] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.898486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.898544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.898748] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.898887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.908102] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a in Status: IN_PROGRESS for 2s [ 1356.922060] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a in Status: SUCCESS [ 1356.922446] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a deletion is rescheduled due to dependency. [ 1356.922446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.347095] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.347095] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.348200] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.348441] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1368.518872] env[69656]: INFO networking_nsxv3.common.synchronization [None req-4ef1d862-1749-49b3-a884-2bef60b6d74b tempest-ServerActionsTestJSON-1918891154 tempest-ServerActionsTestJSON-1918891154-project-member] Enqueued Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGHEST for action security_group_rules [ 1368.519321] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGHEST for action security_group_rules [ 1368.519621] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.519745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.519804] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.520075] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.520162] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43d8c0af-374b-4bce-aa16-8e3b1d7d46e5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.584611] env[69656]: INFO networking_nsxv3.common.synchronization [None req-8db858a4-d8b1-4815-a86c-43844da3de21 tempest-ServerActionsTestJSON-1918891154 tempest-ServerActionsTestJSON-1918891154-project-member] Enqueued Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGHEST for action security_group_rules [ 1368.584611] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGHEST for action security_group_rules [ 1368.584611] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.584611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.040139] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.040402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.040402] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.040548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.040608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.040724] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 already deleted. [ 1369.040795] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.040996] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.041137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.041219] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43d8c0af-374b-4bce-aa16-8e3b1d7d46e5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.559718] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.560113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.560113] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.560226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.560349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.560453] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 already deleted. [ 1369.560569] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.992977] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.993320] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.993320] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.993655] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.993954] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.994192] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.994320] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.994609] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.994723] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.995028] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1370.995112] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1370.995193] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1370.995290] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1370.995404] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1370.995535] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1370.995684] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1371.017729] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1371.017950] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1371.018145] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1371.018348] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.018652] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-b342b563-2d10-4f62-8fd4-03069ef51d5c taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.018845] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.018998] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.019325] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.019497] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b342b563-2d10-4f62-8fd4-03069ef51d5c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.521848] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.522133] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.522273] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.522548] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.522709] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.522868] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port b342b563-2d10-4f62-8fd4-03069ef51d5c not found, creating... [ 1371.523141] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.523302] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.523428] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.523658] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.523803] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.524103] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.524266] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.524390] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.524596] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.524737] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.524880] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: b342b563-2d10-4f62-8fd4-03069ef51d5c is going to be created. [ 1371.550199] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.550338] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.550476] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.550718] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.550945] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.551175] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.221879] env[69656]: INFO networking_nsxv3.common.synchronization [req-778887e8-44b1-48bf-941f-4c373bdf4b91 req-aa4f4488-8302-4251-b10d-faa5b1ce0165 service nova] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_rules [ 1372.222147] env[69656]: INFO networking_nsxv3.common.synchronization [req-778887e8-44b1-48bf-941f-4c373bdf4b91 req-aa4f4488-8302-4251-b10d-faa5b1ce0165 service nova] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1372.222287] env[69656]: INFO networking_nsxv3.common.synchronization [req-778887e8-44b1-48bf-941f-4c373bdf4b91 req-aa4f4488-8302-4251-b10d-faa5b1ce0165 service nova] Enqueued Resource ID: b342b563-2d10-4f62-8fd4-03069ef51d5c with Priority: HIGHEST for action port [ 1372.222507] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_rules [ 1372.222659] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1372.222771] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b342b563-2d10-4f62-8fd4-03069ef51d5c with Priority: HIGHEST for action port [ 1372.223312] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.223434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.223522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.223717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.223795] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.224774] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.224879] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.224945] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.225114] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.225258] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.225380] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.225442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.225620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.225743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.225808] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.226937] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-b342b563-2d10-4f62-8fd4-03069ef51d5c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.227012] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.227078] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.227220] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.227288] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b342b563-2d10-4f62-8fd4-03069ef51d5c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.728989] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.729246] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.729285] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.730144] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b342b563-2d10-4f62-8fd4-03069ef51d5c with status ACTIVE [ 1372.730321] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.730433] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.730500] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.730701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.730813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.730977] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.731082] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.731152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.731297] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.731397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.731566] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.731656] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.731698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.731821] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.731894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.731986] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b342b563-2d10-4f62-8fd4-03069ef51d5c is going to be updated. [ 1372.751083] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.751226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.751258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.751427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.751556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.751737] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.234994] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.737541] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.737967] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.738214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.738561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.738651] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.738776] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be created. [ 1373.768372] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.768372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.768372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.768372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.768372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.770163] env[69656]: INFO networking_nsxv3.common.synchronization [req-5b42eee3-63bd-40c1-aeb1-c47c94d63b46 req-c4c21688-ae4d-4328-9cbe-2631dd978a19 tempest-ServerActionsTestJSON-1918891154 tempest-ServerActionsTestJSON-1918891154-project-member] Enqueued Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGHEST for action security_group_members [ 1373.770709] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGHEST for action security_group_members [ 1373.771549] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.771549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.771549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.771549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.771720] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.771823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.771911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.772090] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.772200] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.772317] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43d8c0af-374b-4bce-aa16-8e3b1d7d46e5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.778998] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: UNINITIALIZED for 2s [ 1374.024173] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.024374] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.024508] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.024783] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.025047] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.025438] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.025438] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.025575] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.025711] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.025922] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1374.026058] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1374.026174] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1374.026286] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1374.026408] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1374.026539] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1374.026679] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1374.044519] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1374.044693] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1374.044834] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1374.045009] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.045287] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-fa63a199-515c-4b7f-83ab-840f67b28b63 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.045454] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-fa63a199-515c-4b7f-83ab-840f67b28b63" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.045643] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-fa63a199-515c-4b7f-83ab-840f67b28b63" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.045932] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-fa63a199-515c-4b7f-83ab-840f67b28b63" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.046090] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa63a199-515c-4b7f-83ab-840f67b28b63',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.273889] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.274288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.274288] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.274377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.274435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.274632] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.274731] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.274794] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.274944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.275025] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.275111] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 already deleted. [ 1374.275187] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.548287] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.548554] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.548685] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.548904] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.549072] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.549235] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port fa63a199-515c-4b7f-83ab-840f67b28b63 not found, creating... [ 1374.549493] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.549661] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.549783] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.550020] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.550176] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.550485] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.550662] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.550819] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.551072] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.551224] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.551369] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: fa63a199-515c-4b7f-83ab-840f67b28b63 is going to be created. [ 1374.570074] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.570074] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.570074] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.570224] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.570470] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.570799] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-fa63a199-515c-4b7f-83ab-840f67b28b63" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.235718] env[69656]: INFO networking_nsxv3.common.synchronization [req-5b42eee3-63bd-40c1-aeb1-c47c94d63b46 req-b4ff65ae-8881-4f63-9b18-0b5391632283 service nova] Enqueued Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGHEST for action security_group_rules [ 1375.235913] env[69656]: INFO networking_nsxv3.common.synchronization [req-5b42eee3-63bd-40c1-aeb1-c47c94d63b46 req-b4ff65ae-8881-4f63-9b18-0b5391632283 service nova] Enqueued Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGHEST for action security_group_members [ 1375.235992] env[69656]: INFO networking_nsxv3.common.synchronization [req-5b42eee3-63bd-40c1-aeb1-c47c94d63b46 req-b4ff65ae-8881-4f63-9b18-0b5391632283 service nova] Enqueued Resource ID: fa63a199-515c-4b7f-83ab-840f67b28b63 with Priority: HIGHEST for action port [ 1375.236235] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGHEST for action security_group_rules [ 1375.236361] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGHEST for action security_group_members [ 1375.236459] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa63a199-515c-4b7f-83ab-840f67b28b63 with Priority: HIGHEST for action port [ 1375.237247] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.237373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.237444] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.237644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.237725] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43d8c0af-374b-4bce-aa16-8e3b1d7d46e5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.241082] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.241276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.241320] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.241473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.241628] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.241726] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.241865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.241931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.242044] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.242099] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43d8c0af-374b-4bce-aa16-8e3b1d7d46e5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.242881] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa63a199-515c-4b7f-83ab-840f67b28b63 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.242987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa63a199-515c-4b7f-83ab-840f67b28b63" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.242987] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa63a199-515c-4b7f-83ab-840f67b28b63" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.243137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa63a199-515c-4b7f-83ab-840f67b28b63" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.243211] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa63a199-515c-4b7f-83ab-840f67b28b63',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.744863] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.745182] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.745217] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43d8c0af-374b-4bce-aa16-8e3b1d7d46e5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.746159] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa63a199-515c-4b7f-83ab-840f67b28b63 with status ACTIVE [ 1375.746701] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.746701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.746701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.746701] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.746865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.746943] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.748346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.748346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.748346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.748346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.748346] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.748346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.748346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.748346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.748346] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.748346] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa63a199-515c-4b7f-83ab-840f67b28b63 is going to be updated. [ 1375.770953] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.771110] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.771166] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.771383] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.771522] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.771673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa63a199-515c-4b7f-83ab-840f67b28b63" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.788620] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1375.788803] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.788941] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.789121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.789277] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.789378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.789440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.789581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.789658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.789739] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.789822] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.249478] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43d8c0af-374b-4bce-aa16-8e3b1d7d46e5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.291280] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.291431] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.291485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.291690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.291846] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.291938] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.291997] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.292151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.292235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.292317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.292456] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.292545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.292603] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.292736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.292864] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.292949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.293014] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.293154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.293228] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.293305] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.293400] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.751576] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.751796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.751796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.752035] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.752121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.752219] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 is going to be created. [ 1376.782934] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.783081] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.783149] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.783347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.783507] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.794416] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 in Status: UNINITIALIZED for 2s [ 1376.794601] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c40e462-de5f-44fc-812b-8caf1dff4c9e: rpc.has_security_group_logging(os_id): False [ 1376.809946] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.810108] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.810172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.810332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.810407] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.810582] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.810692] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.810754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.810882] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.810951] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.811155] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.811249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.811343] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.811452] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.811523] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.811705] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.811795] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.811854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.811990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.812073] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.812154] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be created. [ 1376.883972] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.884143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.884198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.884348] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.884516] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.908816] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1378.803451] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 in Status: SUCCESS [ 1378.803763] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.803763] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.803950] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.804155] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.804268] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.804332] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.804488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.804566] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.804652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.804742] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43d8c0af-374b-4bce-aa16-8e3b1d7d46e5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.923700] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1378.923700] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.306492] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43d8c0af-374b-4bce-aa16-8e3b1d7d46e5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.809562] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5: rpc.has_security_group_logging(os_id): False [ 1379.832769] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.832903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.833032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.833195] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.833286] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.833551] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.833678] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.833752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.833911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.833988] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.834088] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 is going to be created. [ 1379.915344] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.915479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.915544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.915743] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.915920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.929091] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 in Status: IN_PROGRESS for 2s [ 1380.237052] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.237233] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1381.943625] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 in Status: SUCCESS [ 1381.943625] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.238343] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.238672] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1385.735393] env[69656]: INFO networking_nsxv3.common.synchronization [req-d2971a83-5d04-4516-b8cf-4b6ab0e79f7b req-2249f333-87c8-4647-a21c-8b1b93c3cd18 tempest-AttachVolumeShelveTestJSON-958915703 tempest-AttachVolumeShelveTestJSON-958915703-project-member] Enqueued Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_members [ 1385.735942] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 with Priority: HIGHEST for action security_group_members [ 1385.736257] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5f15371-c02b-43e4-b8a5-670ce8c4b232 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.736378] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.736446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.736666] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.736823] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.736922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.736985] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.737145] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.737854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.737854] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5f15371-c02b-43e4-b8a5-670ce8c4b232',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.240021] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.240379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.240379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.240534] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.240602] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.240776] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.240886] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.240944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.241100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.241176] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.241261] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 is going to be updated. [ 1386.275862] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.276067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.276067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.276237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.276365] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.284352] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 in Status: IN_PROGRESS for 2s [ 1388.294863] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 in Status: SUCCESS [ 1388.295145] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5f15371-c02b-43e4-b8a5-670ce8c4b232 deletion is rescheduled due to dependency. [ 1388.295180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5f15371-c02b-43e4-b8a5-670ce8c4b232" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.736793] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1390.736793] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1390.920672] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-350 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.920872] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.921019] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.921289] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.921552] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.921716] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.921840] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.922067] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.922218] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.922442] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1390.922587] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1390.922723] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1390.922771] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1390.922891] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1390.923009] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1390.923148] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1390.941865] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1390.942070] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1390.942415] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1390.942614] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-350" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.942927] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-b342b563-2d10-4f62-8fd4-03069ef51d5c taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.943119] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.943243] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.943502] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.943664] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b342b563-2d10-4f62-8fd4-03069ef51d5c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.445686] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.445946] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.446093] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.446371] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.446530] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.446842] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.447050] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.447186] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.447404] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.447549] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.447833] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.448009] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.448161] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.448377] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.448514] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.448658] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: b342b563-2d10-4f62-8fd4-03069ef51d5c is going to be updated. [ 1391.470912] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.471111] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.471243] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.471483] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.471711] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.471949] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.134022] env[69656]: INFO networking_nsxv3.common.synchronization [req-0a1627bf-a4f4-459d-b81b-83f9f57518fa req-fcefb168-5256-426b-aa97-b6412f99cad1 service nova] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_rules [ 1392.134022] env[69656]: INFO networking_nsxv3.common.synchronization [req-0a1627bf-a4f4-459d-b81b-83f9f57518fa req-fcefb168-5256-426b-aa97-b6412f99cad1 service nova] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1392.134022] env[69656]: INFO networking_nsxv3.common.synchronization [req-0a1627bf-a4f4-459d-b81b-83f9f57518fa req-fcefb168-5256-426b-aa97-b6412f99cad1 service nova] Enqueued Resource ID: b342b563-2d10-4f62-8fd4-03069ef51d5c with Priority: HIGHEST for action port [ 1392.134022] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_rules [ 1392.134022] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1392.134022] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b342b563-2d10-4f62-8fd4-03069ef51d5c with Priority: HIGHEST for action port [ 1392.134899] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.135137] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.135304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.135574] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.135895] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.136775] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.136986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.137151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.137406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.137640] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.137844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.137994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.138257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.139023] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.139023] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.139646] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-b342b563-2d10-4f62-8fd4-03069ef51d5c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.139878] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.140056] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.140276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.140881] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b342b563-2d10-4f62-8fd4-03069ef51d5c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.642497] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.643290] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.643414] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.643552] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b342b563-2d10-4f62-8fd4-03069ef51d5c with status ACTIVE [ 1392.643708] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.643851] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.643907] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.644103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.644192] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.644366] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.644463] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.644526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.644675] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.644754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.644972] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.645072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.645117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.645252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.645328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.645411] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b342b563-2d10-4f62-8fd4-03069ef51d5c is going to be updated. [ 1392.666070] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.666235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.666235] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.666401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.666525] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.666669] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b342b563-2d10-4f62-8fd4-03069ef51d5c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.147707] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.649863] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.650154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.650154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.650340] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.650434] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.650532] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be updated. [ 1393.685333] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.685496] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.685537] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.685730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.685877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.694128] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1395.705400] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1395.705640] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.705716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.705943] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.706150] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.706266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.706326] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.706483] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.706563] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.706648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.706760] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.209740] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.209740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.209740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.209740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.209980] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.209980] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.210067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.210229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.210314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.210398] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.210540] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.210632] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.210693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.210832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.210966] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.211230] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.211537] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.211537] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.211644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.211644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.211743] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.713786] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c40e462-de5f-44fc-812b-8caf1dff4c9e: rpc.has_security_group_logging(os_id): False [ 1396.731188] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.731373] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.731416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.731599] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.731682] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.731870] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.731967] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.732045] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.732202] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.732279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.732486] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.732578] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.732643] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.732772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.732927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.733064] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.733165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.733226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.733364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.733438] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.733521] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be updated. [ 1396.788223] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.788417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.788455] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.788630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.788792] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.801288] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1397.134047] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.134154] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1398.817446] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1398.817446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.135237] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.135692] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.656820] env[69656]: INFO networking_nsxv3.common.synchronization [req-530e5945-e37f-4a71-b714-464f2ee9a347 req-fc21bb73-d27d-4074-b819-d65a06e3539b tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_members [ 1406.657365] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_members [ 1406.657675] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.657796] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.657865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.658209] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.658379] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.658485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.658536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.658693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.658781] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.658873] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.161064] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.663849] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.166863] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.167097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.167097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.167323] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.167419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.167518] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 781f4608-514f-4c7d-a344-49d690a18ab7 is going to be updated. [ 1408.196842] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.197034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.197074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.197257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.197403] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.206166] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: IN_PROGRESS for 2s [ 1410.217709] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: SUCCESS [ 1410.218039] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.658678] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.658678] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1411.852778] env[69656]: INFO networking_nsxv3.common.synchronization [req-690e8d95-8f3c-4ae5-9cfd-b0e1876f6b26 req-2a03e50a-a4a7-4d7f-afdb-20cb12b297d3 tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_members [ 1411.853264] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGHEST for action security_group_members [ 1411.853571] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.853693] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.853781] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.853978] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.854158] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.854258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.854318] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.854461] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.854546] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.854638] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.356560] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.356807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.356807] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.357126] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.357249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.357476] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.357594] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.357661] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.357817] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.357894] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.358015] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 781f4608-514f-4c7d-a344-49d690a18ab7 is going to be updated. [ 1412.385138] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.385249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.385329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.385487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.385617] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.393544] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: IN_PROGRESS for 2s [ 1414.403530] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 781f4608-514f-4c7d-a344-49d690a18ab7 in Status: SUCCESS [ 1414.403898] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 781f4608-514f-4c7d-a344-49d690a18ab7 deletion is rescheduled due to dependency. [ 1414.403898] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.803045] env[69656]: INFO networking_nsxv3.common.synchronization [None req-058af500-7306-4ca1-8666-da8132415ff3 tempest-AttachInterfacesTestJSON-1282078155 tempest-AttachInterfacesTestJSON-1282078155-project-member] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1415.803561] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGHEST for action security_group_members [ 1415.803868] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.803995] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.804192] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.804397] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.804558] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.804658] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.804744] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.804851] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.804935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.805044] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.307291] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.307493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.307531] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.309304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.309304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.309304] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.309304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.309304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.309304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.309304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.309304] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be updated. [ 1416.336060] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.336240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.336330] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.336554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.336554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.344368] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: IN_PROGRESS for 2s [ 1418.355298] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e in Status: SUCCESS [ 1418.355636] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e deletion is rescheduled due to dependency. [ 1418.355636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.263283] env[69656]: INFO networking_nsxv3.common.synchronization [None req-32200a30-3a6b-4d4f-b80f-ab920e457bbc None None] Enqueued Resource ID: a28b558d-9474-4bfd-8643-4de2d76ae29a with Priority: HIGHEST for action port [ 1419.263554] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28b558d-9474-4bfd-8643-4de2d76ae29a with Priority: HIGHEST for action port [ 1419.264148] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-a28b558d-9474-4bfd-8643-4de2d76ae29a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.264273] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a28b558d-9474-4bfd-8643-4de2d76ae29a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.264339] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a28b558d-9474-4bfd-8643-4de2d76ae29a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.264619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a28b558d-9474-4bfd-8643-4de2d76ae29a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.264694] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a28b558d-9474-4bfd-8643-4de2d76ae29a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.766649] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a28b558d-9474-4bfd-8643-4de2d76ae29a [ 1419.769234] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.769234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.769234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.769234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.769234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.769234] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a28b558d-9474-4bfd-8643-4de2d76ae29a already deleted. [ 1419.769234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a28b558d-9474-4bfd-8643-4de2d76ae29a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.484092] env[69656]: INFO networking_nsxv3.common.synchronization [None req-8a22eb2a-9bbe-47e1-83c0-a76e7a5f8490 None None] Enqueued Resource ID: 01a1fd8e-0435-4c09-9784-7c2060c2324c with Priority: HIGHEST for action port [ 1421.484092] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a1fd8e-0435-4c09-9784-7c2060c2324c with Priority: HIGHEST for action port [ 1421.484092] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-01a1fd8e-0435-4c09-9784-7c2060c2324c taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.484092] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01a1fd8e-0435-4c09-9784-7c2060c2324c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.484092] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01a1fd8e-0435-4c09-9784-7c2060c2324c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.484092] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01a1fd8e-0435-4c09-9784-7c2060c2324c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.484092] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01a1fd8e-0435-4c09-9784-7c2060c2324c',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.986415] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01a1fd8e-0435-4c09-9784-7c2060c2324c [ 1421.986415] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.986415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.986415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.986415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.986415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.986415] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01a1fd8e-0435-4c09-9784-7c2060c2324c already deleted. [ 1421.986415] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01a1fd8e-0435-4c09-9784-7c2060c2324c" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.459016] env[69656]: INFO networking_nsxv3.common.synchronization [req-55569cda-f4e9-4eb5-b83c-3481b38f3a9d req-1f68b692-b331-4276-a11c-49c683f18636 tempest-InstanceActionsNegativeTestJSON-128270844 tempest-InstanceActionsNegativeTestJSON-128270844-project-member] Enqueued Resource ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 with Priority: HIGHEST for action security_group_members [ 1424.459641] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 with Priority: HIGHEST for action security_group_members [ 1424.460007] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8f45f72-36f2-47f1-8c31-31b61975bfb3 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.460144] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.460238] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.460488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.460643] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.460741] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.460801] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.460946] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.461037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.461127] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8f45f72-36f2-47f1-8c31-31b61975bfb3',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.722643] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-68 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.722853] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-68" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.722985] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-68" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.723467] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-68" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.723585] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.723751] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.723871] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.724223] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.724396] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.724646] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1424.724768] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1424.724884] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1424.724998] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1424.725127] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1424.725244] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1424.725381] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1424.744825] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1424.744979] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1424.745141] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1424.745324] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-68" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.745603] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-23c9b22f-d6d9-4aad-8b35-59b1eec167ee taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.745770] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-23c9b22f-d6d9-4aad-8b35-59b1eec167ee" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.745893] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-23c9b22f-d6d9-4aad-8b35-59b1eec167ee" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.746225] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-23c9b22f-d6d9-4aad-8b35-59b1eec167ee" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.746365] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23c9b22f-d6d9-4aad-8b35-59b1eec167ee',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.967051] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.967333] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.967423] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.967657] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.967754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.967968] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.968089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.968154] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.968317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.968416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.968504] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 already deleted. [ 1424.968583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.248888] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.249196] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.249337] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.249619] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.249773] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.249936] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port 23c9b22f-d6d9-4aad-8b35-59b1eec167ee not found, creating... [ 1425.250928] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.250928] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.250928] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.250928] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.250928] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.251216] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.251401] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.251471] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.251669] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.251848] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.252014] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: 23c9b22f-d6d9-4aad-8b35-59b1eec167ee is going to be created. [ 1425.271557] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.271816] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.271861] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.272160] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.272394] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.272617] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-23c9b22f-d6d9-4aad-8b35-59b1eec167ee" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.128223] env[69656]: INFO networking_nsxv3.common.synchronization [req-55569cda-f4e9-4eb5-b83c-3481b38f3a9d req-d18be36f-cf35-4e41-abf4-0d67480d2e67 service nova] Enqueued Resource ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 with Priority: HIGHEST for action security_group_rules [ 1426.128223] env[69656]: INFO networking_nsxv3.common.synchronization [req-55569cda-f4e9-4eb5-b83c-3481b38f3a9d req-d18be36f-cf35-4e41-abf4-0d67480d2e67 service nova] Enqueued Resource ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 with Priority: HIGHEST for action security_group_members [ 1426.128223] env[69656]: INFO networking_nsxv3.common.synchronization [req-55569cda-f4e9-4eb5-b83c-3481b38f3a9d req-d18be36f-cf35-4e41-abf4-0d67480d2e67 service nova] Enqueued Resource ID: 23c9b22f-d6d9-4aad-8b35-59b1eec167ee with Priority: HIGHEST for action port [ 1426.128223] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 with Priority: HIGHEST for action security_group_rules [ 1426.128223] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 with Priority: HIGHEST for action security_group_members [ 1426.128223] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c9b22f-d6d9-4aad-8b35-59b1eec167ee with Priority: HIGHEST for action port [ 1426.128223] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8f45f72-36f2-47f1-8c31-31b61975bfb3 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.128223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.128223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.128838] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.129037] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8f45f72-36f2-47f1-8c31-31b61975bfb3',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.130479] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8f45f72-36f2-47f1-8c31-31b61975bfb3 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.131314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.131314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.131314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.131314] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.131314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.131314] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.131642] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.131717] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.131828] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8f45f72-36f2-47f1-8c31-31b61975bfb3',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.132619] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-23c9b22f-d6d9-4aad-8b35-59b1eec167ee taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.132733] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23c9b22f-d6d9-4aad-8b35-59b1eec167ee" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.132824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23c9b22f-d6d9-4aad-8b35-59b1eec167ee" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.132994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23c9b22f-d6d9-4aad-8b35-59b1eec167ee" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.133117] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23c9b22f-d6d9-4aad-8b35-59b1eec167ee',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.635085] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8f45f72-36f2-47f1-8c31-31b61975bfb3',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.636349] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8f45f72-36f2-47f1-8c31-31b61975bfb3 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.636475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.636654] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23c9b22f-d6d9-4aad-8b35-59b1eec167ee with status ACTIVE [ 1426.636836] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.636930] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.637022] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.637258] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.637382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.637557] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.637678] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.637747] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.637912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.638072] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.638230] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.638409] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.638409] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.638591] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.638670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.638776] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23c9b22f-d6d9-4aad-8b35-59b1eec167ee is going to be updated. [ 1426.657483] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.657641] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.657684] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.657869] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.658046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.658222] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23c9b22f-d6d9-4aad-8b35-59b1eec167ee" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.141476] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8f45f72-36f2-47f1-8c31-31b61975bfb3',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.643669] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.643870] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.643914] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.644218] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.644331] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.644460] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 is going to be created. [ 1427.666710] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.666931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.666931] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.667090] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.667276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.693919] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 in Status: UNINITIALIZED for 2s [ 1429.704615] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 in Status: SUCCESS [ 1429.704912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.705027] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.705198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.705384] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.705495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.705556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.705702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.705780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.705863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.705950] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8f45f72-36f2-47f1-8c31-31b61975bfb3',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.208589] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8f45f72-36f2-47f1-8c31-31b61975bfb3 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.208791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.208791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.208975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.209226] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.209334] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.209430] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.209583] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.209672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.209766] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.209963] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8f45f72-36f2-47f1-8c31-31b61975bfb3 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.210074] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.210135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.210281] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.210525] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.210631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.210691] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.211083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.211083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.211083] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.211083] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8f45f72-36f2-47f1-8c31-31b61975bfb3',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.713912] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8f45f72-36f2-47f1-8c31-31b61975bfb3: rpc.has_security_group_logging(os_id): False [ 1430.732138] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.732316] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.732422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.732848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.733049] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.733367] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.733532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.733631] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.733865] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.733988] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.734299] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.734446] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.734544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.734754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.734874] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.735179] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.735327] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.735425] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.735636] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.735765] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.735898] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 is going to be created. [ 1430.813362] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.813508] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.813573] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.813778] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.813953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.823436] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 in Status: IN_PROGRESS for 2s [ 1431.128663] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.128663] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1432.837537] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 in Status: SUCCESS [ 1432.837932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.908776] env[69656]: INFO networking_nsxv3.common.synchronization [req-1a6b4716-c27e-472e-b2e1-ce4945a3a20f req-02bd652f-b2d9-4ee4-9bed-8992db036f80 tempest-InstanceActionsNegativeTestJSON-128270844 tempest-InstanceActionsNegativeTestJSON-128270844-project-member] Enqueued Resource ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 with Priority: HIGHEST for action security_group_members [ 1434.909313] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 with Priority: HIGHEST for action security_group_members [ 1434.909645] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8f45f72-36f2-47f1-8c31-31b61975bfb3 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.909730] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.909799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.909986] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.910299] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.910439] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.910504] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.910669] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.910777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.910860] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8f45f72-36f2-47f1-8c31-31b61975bfb3',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.412770] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.412969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.413103] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.413350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.413465] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.413710] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.413845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.413917] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.414147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.414237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.414339] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 is going to be updated. [ 1435.441893] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.442100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.442100] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.442313] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.442453] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.450920] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 in Status: IN_PROGRESS for 2s [ 1437.461663] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 in Status: SUCCESS [ 1437.461918] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 deletion is rescheduled due to dependency. [ 1437.461953] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.910406] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1439.910693] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1444.911382] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.911382] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1449.912342] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1449.912342] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1454.912822] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.913141] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1459.914370] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.914370] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1464.915613] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.915613] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1465.738477] env[69656]: INFO networking_nsxv3.common.synchronization [req-8751a194-f807-47bc-9c0c-285a4fb48bfc req-18639631-7e02-4aa4-93af-ff8cc4e33de0 tempest-ServerActionsTestJSON-1918891154 tempest-ServerActionsTestJSON-1918891154-project-member] Enqueued Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGHEST for action security_group_members [ 1465.739057] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGHEST for action security_group_members [ 1465.739363] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.739485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.739547] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.739754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.739903] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.740009] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.740089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.740223] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.740412] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.740412] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43d8c0af-374b-4bce-aa16-8e3b1d7d46e5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.243573] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.243933] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.243933] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.244026] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.244088] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.244290] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.244406] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.244469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.244630] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.244709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.244795] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 is going to be updated. [ 1466.272533] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.272668] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.272707] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.272863] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.272990] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.280493] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 in Status: IN_PROGRESS for 2s [ 1468.293687] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 in Status: SUCCESS [ 1468.293687] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 deletion is rescheduled due to dependency. [ 1468.293687] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.740414] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.740819] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1475.741917] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.742289] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1480.742967] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1480.743347] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1485.744918] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1485.744918] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1490.745687] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.746053] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.747038] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.747468] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1498.689983] env[69656]: INFO networking_nsxv3.common.synchronization [req-0ab5e44c-6fc1-4f8a-b651-327285028bdc req-4c7273af-bf83-40d2-b97b-766f3d616888 tempest-ServerActionsTestJSON-1918891154 tempest-ServerActionsTestJSON-1918891154-project-member] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1498.690742] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1498.690812] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.690935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.691037] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.691207] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.691393] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.691497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.691556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.691702] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.691787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.691915] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.194765] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.194969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.194969] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.195219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.214876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.215102] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.215211] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.215274] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.215440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.215521] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.215611] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 is going to be updated. [ 1499.241670] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.241787] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.241824] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.241984] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.242122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.248920] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: IN_PROGRESS for 2s [ 1501.260111] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: SUCCESS [ 1501.260416] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 deletion is rescheduled due to dependency. [ 1501.260416] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.691493] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1503.691806] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1505.982532] env[69656]: INFO networking_nsxv3.common.synchronization [req-6372a9b6-8976-4acc-9068-035033135408 req-cc35475f-f806-47d0-84db-a04b8d8b26c6 tempest-ServerActionsTestJSON-1918891154 tempest-ServerActionsTestJSON-1918891154-project-member] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1505.982532] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1505.982532] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.982532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.982532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.982532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.982532] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.982532] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.983388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.983388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.983388] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.983388] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.238490] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.238756] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.238913] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.239250] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.239555] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.239761] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.239916] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.240194] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.240388] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.240651] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1506.240784] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1506.240932] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1506.241091] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1506.241233] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1506.241372] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1506.241546] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1506.262302] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1506.262439] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1506.262577] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1506.262743] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.263016] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-e05afb41-3814-445f-950d-a0820fc2e7fb taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.263188] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-e05afb41-3814-445f-950d-a0820fc2e7fb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.263313] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-e05afb41-3814-445f-950d-a0820fc2e7fb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.263609] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-e05afb41-3814-445f-950d-a0820fc2e7fb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.263752] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e05afb41-3814-445f-950d-a0820fc2e7fb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.485078] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.485280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.485280] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.485485] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.485576] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.485772] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.485877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.485928] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.486089] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.486175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.486237] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 is going to be updated. [ 1506.509303] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.509545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.509545] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.509736] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.509876] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.517745] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: IN_PROGRESS for 2s [ 1506.766387] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.766626] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.766764] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.767133] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.767310] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.767470] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port e05afb41-3814-445f-950d-a0820fc2e7fb not found, creating... [ 1506.767743] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.767915] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.768045] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.768286] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.768431] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.768728] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.768891] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.769027] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.769274] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.769425] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.769575] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: e05afb41-3814-445f-950d-a0820fc2e7fb is going to be created. [ 1506.790270] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.790270] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.790270] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.790270] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.790270] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.790270] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-e05afb41-3814-445f-950d-a0820fc2e7fb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.470135] env[69656]: INFO networking_nsxv3.common.synchronization [req-6372a9b6-8976-4acc-9068-035033135408 req-560fb231-586c-4ddd-9aeb-e83676456b88 service nova] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_rules [ 1507.470428] env[69656]: INFO networking_nsxv3.common.synchronization [req-6372a9b6-8976-4acc-9068-035033135408 req-560fb231-586c-4ddd-9aeb-e83676456b88 service nova] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1507.470507] env[69656]: INFO networking_nsxv3.common.synchronization [req-6372a9b6-8976-4acc-9068-035033135408 req-560fb231-586c-4ddd-9aeb-e83676456b88 service nova] Enqueued Resource ID: e05afb41-3814-445f-950d-a0820fc2e7fb with Priority: HIGHEST for action port [ 1507.470690] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_rules [ 1507.470816] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1507.470924] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e05afb41-3814-445f-950d-a0820fc2e7fb with Priority: HIGHEST for action port [ 1507.471485] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.471597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.471648] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.471849] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.471931] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.472735] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.472827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.473014] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-e05afb41-3814-445f-950d-a0820fc2e7fb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.473119] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e05afb41-3814-445f-950d-a0820fc2e7fb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.473185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e05afb41-3814-445f-950d-a0820fc2e7fb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.473361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e05afb41-3814-445f-950d-a0820fc2e7fb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.473434] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e05afb41-3814-445f-950d-a0820fc2e7fb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.975619] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.975793] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.975914] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e05afb41-3814-445f-950d-a0820fc2e7fb with status ACTIVE [ 1507.976094] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.976283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.976283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.976466] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.976520] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.976681] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.976823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.976823] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.977011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.977099] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.977289] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.977382] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.977440] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.977597] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.977649] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.977729] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e05afb41-3814-445f-950d-a0820fc2e7fb is going to be updated. [ 1507.999041] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.999193] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.999229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.999384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.999506] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.999652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e05afb41-3814-445f-950d-a0820fc2e7fb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.527028] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: SUCCESS [ 1508.527028] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 deletion is rescheduled due to dependency. [ 1508.527028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.527028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.527028] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.527486] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.527486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.527486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.527486] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.527615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.527615] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.029648] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.532115] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.034523] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.034674] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.034745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.035012] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.035121] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.035226] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 is going to be updated. [ 1510.062781] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.062944] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.062979] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.063189] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.063329] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.071068] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: IN_PROGRESS for 2s [ 1512.082663] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: SUCCESS [ 1512.082920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.082920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.083151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.083335] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.083447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.083511] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.083676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.083779] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.083841] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.083925] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.471651] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1512.471847] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1512.586155] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.089048] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8: rpc.has_security_group_logging(os_id): False [ 1513.106794] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.106999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.106999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.107242] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.107349] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.107613] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.107714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.107777] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.107927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.108008] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.108099] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 is going to be updated. [ 1513.161752] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.161903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.161903] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.162051] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.162229] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.176043] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: IN_PROGRESS for 2s [ 1515.188946] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: SUCCESS [ 1515.189324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.473051] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1517.473426] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1522.474863] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1522.475337] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1527.476865] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.477275] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.478752] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.479189] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1537.480060] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1537.480452] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1542.482149] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1542.482583] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.483341] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1547.483765] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1552.485125] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1552.485473] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1557.486942] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.487424] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1562.488952] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1562.489374] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1566.706251] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.706251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.706251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.706251] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.706251] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1566.762048] env[69656]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1566.762232] env[69656]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-211fedca-4bdc-44d5-a193-fbe84a6328b6 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1567.208928] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.490594] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1567.490774] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1567.711560] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.214589] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1568.214836] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1568.952202] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.952544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.952544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.952620] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.965703] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1568.966514] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.967303] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1569.003369] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.003535] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.003607] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.003752] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.018217] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.018929] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1569.019015] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1569.019110] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1569.051011] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.051155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.051226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.051385] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.052130] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.052269] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1569.130402] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.130590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.130590] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.130779] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.131070] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.131323] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1569.201414] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.201581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.201581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.201754] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.202042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.202308] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:31. [ 1569.202395] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'e8f45f72-36f2-47f1-8c31-31b61975bfb3', '38729b4b-23ae-4e26-b524-9c3d018d87eb', '6d9740de-f67c-4fbd-a249-44afc4caaef1', 'e7c27843-e365-4bd4-9103-dc94b0c2a637', '06966f07-554f-446e-a2a7-17a62c52a519', '3746f1b2-61cd-415b-a74b-1d4da3f9731f', '43d8c0af-374b-4bce-aa16-8e3b1d7d46e5', '841baacb-db1a-4155-8c56-e0d487b1795b', '012722d0-145e-4c53-8203-3606845f8f43', '3274dea2-eaf7-4169-ba91-1154eac58032', '781f4608-514f-4c7d-a344-49d690a18ab7', '792b043f-2560-4918-890f-99f50b059db4', 'fbfd950d-8069-4f04-a8ec-2ff80f29dc2a', '0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b', 'c35bc1ec-d02e-41f7-b05b-c27e0d977c43', '037b783b-a9e4-4669-8461-2452a42615e1', 'fe7fb2d8-2929-4f36-a2da-bafb532a875d', '3a714e7c-1123-47f3-81e4-70f097603f3e', '5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8', '6c40e462-de5f-44fc-812b-8caf1dff4c9e', '77d2c3a5-526e-400a-8792-5423d2e6c534', '8e938057-3189-4358-8ca5-5e18d05bbddf', 'd70c367d-ca7b-45b3-9579-5b05739f400a', '4a133f47-cf05-42f1-8365-6a566b72e14d', 'a5f15371-c02b-43e4-b8a5-670ce8c4b232', '7b0f9291-4852-4d43-9155-e275aacce00d', '1d9405cd-478a-474f-af17-55246ce5acfa', 'a9634e32-b0d5-42d5-ad50-a2e3f0b08cbf', 'f3521005-0bf3-4791-8930-fe6bb6c94423', 'a0e73dee-afe4-4a44-9672-c68cc0af0557', '8a9ee1b5-46c4-4ea5-a724-f697a2014dcb'} {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1569.202471] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1569.220930] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.221097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.221143] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.221284] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.221361] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.221457] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1569.221527] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1569.221597] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1569.293810] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.293972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.294033] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.294184] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.295279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.295523] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1569.295589] env[69656]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69656) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1569.295661] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1569.295728] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1569.295822] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/31 resources of Type:Security Group Rules [ 1569.295896] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 with Priority: HIGH for action security_group_rules [ 1569.295973] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGH for action security_group_rules [ 1569.296048] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGH for action security_group_rules [ 1569.296111] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 with Priority: HIGH for action security_group_rules [ 1569.296173] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGH for action security_group_rules [ 1569.296233] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGH for action security_group_rules [ 1569.296292] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGH for action security_group_rules [ 1569.296351] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGH for action security_group_rules [ 1569.296412] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 012722d0-145e-4c53-8203-3606845f8f43 with Priority: HIGH for action security_group_rules [ 1569.296471] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGH for action security_group_rules [ 1569.296530] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGH for action security_group_rules [ 1569.296590] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGH for action security_group_rules [ 1569.296649] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGH for action security_group_rules [ 1569.296743] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGH for action security_group_rules [ 1569.296787] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 with Priority: HIGH for action security_group_rules [ 1569.296825] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGH for action security_group_rules [ 1569.296876] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGH for action security_group_rules [ 1569.296934] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGH for action security_group_rules [ 1569.296993] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGH for action security_group_rules [ 1569.297061] env[69656]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGH for action security_group_rules [ 1569.297151] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.492064] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1572.492064] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1572.492064] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 with Priority: HIGH for action security_group_rules [ 1572.492064] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 with Priority: HIGH for action security_group_rules [ 1572.492064] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 with Priority: HIGH for action security_group_rules [ 1572.492558] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 with Priority: HIGH for action security_group_rules [ 1572.492558] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e with Priority: HIGH for action security_group_rules [ 1572.492558] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGH for action security_group_rules [ 1572.492558] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a714e7c-1123-47f3-81e4-70f097603f3e with Priority: HIGH for action security_group_rules [ 1572.492558] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d with Priority: HIGH for action security_group_rules [ 1572.492719] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b with Priority: HIGH for action security_group_rules [ 1572.492719] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037b783b-a9e4-4669-8461-2452a42615e1 with Priority: HIGH for action security_group_rules [ 1572.492785] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a with Priority: HIGH for action security_group_rules [ 1572.492821] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 792b043f-2560-4918-890f-99f50b059db4 with Priority: HIGH for action security_group_rules [ 1572.492891] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 781f4608-514f-4c7d-a344-49d690a18ab7 with Priority: HIGH for action security_group_rules [ 1572.492975] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3274dea2-eaf7-4169-ba91-1154eac58032 with Priority: HIGH for action security_group_rules [ 1572.493073] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012722d0-145e-4c53-8203-3606845f8f43 with Priority: HIGH for action security_group_rules [ 1572.493160] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f with Priority: HIGH for action security_group_rules [ 1572.493246] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841baacb-db1a-4155-8c56-e0d487b1795b with Priority: HIGH for action security_group_rules [ 1572.493332] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06966f07-554f-446e-a2a7-17a62c52a519 with Priority: HIGH for action security_group_rules [ 1572.493416] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb with Priority: HIGH for action security_group_rules [ 1572.493502] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 with Priority: HIGH for action security_group_rules [ 1572.493851] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8f45f72-36f2-47f1-8c31-31b61975bfb3 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.493980] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.494059] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.494279] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.494365] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8f45f72-36f2-47f1-8c31-31b61975bfb3',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.495359] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d9740de-f67c-4fbd-a249-44afc4caaef1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.495481] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.495549] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.495714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.495787] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d9740de-f67c-4fbd-a249-44afc4caaef1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.496736] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.498735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.498735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.498735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.498735] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43d8c0af-374b-4bce-aa16-8e3b1d7d46e5',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.498735] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35bc1ec-d02e-41f7-b05b-c27e0d977c43 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.498735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.498735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.498735] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.498735] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35bc1ec-d02e-41f7-b05b-c27e0d977c43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.499436] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.499493] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.499528] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.499672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.499770] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c40e462-de5f-44fc-812b-8caf1dff4c9e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.501076] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.501264] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.501335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.501484] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.501557] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.502498] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a714e7c-1123-47f3-81e4-70f097603f3e taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.502627] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.502683] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.502933] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.503018] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a714e7c-1123-47f3-81e4-70f097603f3e',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.503886] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.504042] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.504081] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.504216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.504287] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe7fb2d8-2929-4f36-a2da-bafb532a875d',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.505193] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.505322] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.505391] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.505544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.505614] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.506522] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-037b783b-a9e4-4669-8461-2452a42615e1 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.506645] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.506715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.506864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.506935] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('037b783b-a9e4-4669-8461-2452a42615e1',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.510162] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.510328] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.510408] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.510564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.510639] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbfd950d-8069-4f04-a8ec-2ff80f29dc2a',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.511941] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-792b043f-2560-4918-890f-99f50b059db4 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.512080] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.512150] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.512488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.512601] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('792b043f-2560-4918-890f-99f50b059db4',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.513513] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-781f4608-514f-4c7d-a344-49d690a18ab7 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.513599] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.513762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.513920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.513992] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('781f4608-514f-4c7d-a344-49d690a18ab7',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.515072] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3274dea2-eaf7-4169-ba91-1154eac58032 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.515289] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.515363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.515706] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.515790] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3274dea2-eaf7-4169-ba91-1154eac58032',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.516434] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-012722d0-145e-4c53-8203-3606845f8f43 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.516556] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.516603] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.516745] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.516806] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('012722d0-145e-4c53-8203-3606845f8f43',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.518045] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.518164] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.518216] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.518362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.518431] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3746f1b2-61cd-415b-a74b-1d4da3f9731f',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.519594] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841baacb-db1a-4155-8c56-e0d487b1795b taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.519699] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.519762] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.519975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.520070] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841baacb-db1a-4155-8c56-e0d487b1795b',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.521225] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06966f07-554f-446e-a2a7-17a62c52a519 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.521335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.521405] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.521553] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.521625] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06966f07-554f-446e-a2a7-17a62c52a519',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.522914] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38729b4b-23ae-4e26-b524-9c3d018d87eb taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.523152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.523152] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.523234] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.523358] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38729b4b-23ae-4e26-b524-9c3d018d87eb',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.524358] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7c27843-e365-4bd4-9103-dc94b0c2a637 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.524472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.524541] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.524673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.524832] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7c27843-e365-4bd4-9103-dc94b0c2a637',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.044202] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.044443] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.044550] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.044877] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.045190] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.045755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.045755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.045755] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.045972] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.046101] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.046249] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.050359] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.050544] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.050644] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.050912] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.057219] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.057377] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.066827] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.066995] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.075278] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.075435] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.107735] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.107927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.108993] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.109165] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.114673] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.114869] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.115806] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.115949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.116994] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.117172] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.118186] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.118347] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.119367] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.119524] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.120368] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1573.120902] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.121050] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.121925] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1573.122414] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.122564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.123465] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1573.124015] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.124175] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.124948] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1573.125475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.125653] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 037b783b-a9e4-4669-8461-2452a42615e1 is going to be deleted. [ 1573.127691] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.127842] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.127956] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.128266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.130276] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.130420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.131289] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1573.131843] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.131999] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.133221] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1573.133757] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.133920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.134752] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1573.135241] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.135381] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.150392] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1573.150909] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.151109] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38729b4b-23ae-4e26-b524-9c3d018d87eb is going to be deleted. [ 1573.152208] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.152488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.179198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.179393] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbfd950d-8069-4f04-a8ec-2ff80f29dc2a is going to be deleted. [ 1573.180564] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.180845] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.193508] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.193709] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.199616] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.199730] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 781f4608-514f-4c7d-a344-49d690a18ab7 is going to be deleted. [ 1573.200562] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.200764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.215242] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.215363] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.219362] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.219478] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43d8c0af-374b-4bce-aa16-8e3b1d7d46e5 is going to be deleted. [ 1573.220248] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.220447] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.233399] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.233539] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.237864] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.237998] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 012722d0-145e-4c53-8203-3606845f8f43 is going to be deleted. [ 1573.238949] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.239180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.263994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.264142] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841baacb-db1a-4155-8c56-e0d487b1795b is going to be deleted. [ 1573.264942] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.265160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.307677] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.307804] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.311773] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.311889] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.312605] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.312724] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a714e7c-1123-47f3-81e4-70f097603f3e is going to be deleted. [ 1573.313554] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.313758] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.337110] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.337214] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.358294] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.358411] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d9740de-f67c-4fbd-a249-44afc4caaef1 is going to be deleted. [ 1573.359278] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.359487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.403715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.403867] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b is going to be deleted. [ 1573.404786] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.404976] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.470614] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.470812] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.480507] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.480698] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.481304] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.481401] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.513559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.513900] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7c27843-e365-4bd4-9103-dc94b0c2a637 is going to be deleted. [ 1573.514611] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.514825] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.537079] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.537249] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.560794] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.595642] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.595787] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3274dea2-eaf7-4169-ba91-1154eac58032 is going to be deleted. [ 1573.596695] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.596904] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.664472] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.664615] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe7fb2d8-2929-4f36-a2da-bafb532a875d is going to be deleted. [ 1573.665442] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.665673] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.684823] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.684948] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.701685] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.701801] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3746f1b2-61cd-415b-a74b-1d4da3f9731f is going to be deleted. [ 1573.702536] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.702726] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.733283] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.733398] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35bc1ec-d02e-41f7-b05b-c27e0d977c43 is going to be deleted. [ 1573.734105] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.734293] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.776695] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.776887] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.779252] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.779369] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8f45f72-36f2-47f1-8c31-31b61975bfb3 is going to be deleted. [ 1573.780198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.780396] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.824820] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.825020] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 792b043f-2560-4918-890f-99f50b059db4 is going to be deleted. [ 1573.826200] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.826473] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.864980] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.865135] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.883132] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.883253] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.883982] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.884109] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06966f07-554f-446e-a2a7-17a62c52a519 is going to be deleted. [ 1573.884860] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.885063] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.919478] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.919578] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c40e462-de5f-44fc-812b-8caf1dff4c9e is going to be deleted. [ 1573.920798] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.920895] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.920968] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.921160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.921237] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.921384] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8f45f72-36f2-47f1-8c31-31b61975bfb3" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.921479] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.921653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.921773] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.921891] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-037b783b-a9e4-4669-8461-2452a42615e1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.922034] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.922180] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.922257] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.922369] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38729b4b-23ae-4e26-b524-9c3d018d87eb" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.922495] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.922634] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.922711] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.922822] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbfd950d-8069-4f04-a8ec-2ff80f29dc2a" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.923247] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.923399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.923476] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.923588] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43d8c0af-374b-4bce-aa16-8e3b1d7d46e5" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.923716] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.923854] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.923922] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.924046] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-012722d0-145e-4c53-8203-3606845f8f43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.924160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.924291] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.924364] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.924470] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-781f4608-514f-4c7d-a344-49d690a18ab7" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.924593] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.924726] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.924798] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.924901] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841baacb-db1a-4155-8c56-e0d487b1795b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.925017] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.925155] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.925226] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.925330] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a714e7c-1123-47f3-81e4-70f097603f3e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.925469] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.925615] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.925689] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.925791] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d9740de-f67c-4fbd-a249-44afc4caaef1" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.925902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.926040] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.926112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.926215] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b698b5c-5c6b-480c-bb5c-ef9b1d77a60b" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.926341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.926474] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.926548] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.926652] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7c27843-e365-4bd4-9103-dc94b0c2a637" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.926757] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.926885] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.926956] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.927071] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3274dea2-eaf7-4169-ba91-1154eac58032" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.927189] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.927321] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.927391] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.927487] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3746f1b2-61cd-415b-a74b-1d4da3f9731f" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.927619] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.927780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.927896] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.928117] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe7fb2d8-2929-4f36-a2da-bafb532a875d" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.949971] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.950170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.950170] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.950335] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.950411] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.950517] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35bc1ec-d02e-41f7-b05b-c27e0d977c43" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.001360] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.001533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.001533] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.001715] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.001799] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.001911] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-792b043f-2560-4918-890f-99f50b059db4" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.054191] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.054417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.054417] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.054558] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.054680] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.054772] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06966f07-554f-446e-a2a7-17a62c52a519" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.063144] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8: rpc.has_security_group_logging(os_id): False [ 1574.086148] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.086298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.086298] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.086475] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.086559] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.086670] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c40e462-de5f-44fc-812b-8caf1dff4c9e" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.110398] env[69656]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1574.110988] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.111147] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.111210] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.111350] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.146245] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.146498] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.146608] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.146676] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.146844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.146924] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.147022] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 is going to be updated. [ 1574.266878] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.267116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.267116] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.267289] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.267433] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.282669] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: IN_PROGRESS for 2s [ 1576.296246] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: SUCCESS [ 1576.296653] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1577.494711] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1577.495439] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1582.496396] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1582.496784] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1585.275169] env[69656]: INFO networking_nsxv3.common.synchronization [req-9b9cde36-b421-4c6d-8ace-02b41a37d72e req-b9a6cad6-f938-4c67-a4a9-2e0e406ee14b tempest-ServerActionsTestJSON-1918891154 tempest-ServerActionsTestJSON-1918891154-project-member] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1585.275709] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1585.276036] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.276164] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.276231] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.276419] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.276560] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.276655] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.276714] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.277662] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.277832] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.277953] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.780186] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.780379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.780379] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.780577] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.780669] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.780860] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.780959] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.781032] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.781185] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.781259] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.781345] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 is going to be updated. [ 1585.813612] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.813776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.813776] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.813939] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.814081] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.821451] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: IN_PROGRESS for 2s [ 1587.832363] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: SUCCESS [ 1587.832663] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 deletion is rescheduled due to dependency. [ 1587.832663] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.276846] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1590.277224] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1595.278443] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1595.278832] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1595.791265] env[69656]: INFO networking_nsxv3.common.synchronization [req-4f4e4520-b562-401c-8952-20a62fb4a744 req-404ebd4c-2899-4891-9d3b-cf673c5a0f7a tempest-ServerActionsTestJSON-1918891154 tempest-ServerActionsTestJSON-1918891154-project-member] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1595.791792] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1595.792119] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.792244] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.792304] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.792494] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.792642] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.792775] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.792827] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.792923] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.793010] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.793234] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.023551] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.023801] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.023969] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.024300] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.024660] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.024850] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.025011] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.025266] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.025446] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.025728] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1596.025865] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] NeedRegenerationException {{(pid=69656) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1596.026025] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] no value, waiting for create lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1596.026187] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] value creation lock acquired {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1596.026350] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] No value present for key: 'zone-id' {{(pid=69656) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1596.026473] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Calling creation function for not-yet-present value {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1596.026638] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1596.047558] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1596.047694] env[69656]: DEBUG dogpile.cache.region [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69656) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1596.048064] env[69656]: DEBUG dogpile.lock [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Released creation lock {{(pid=69656) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1596.048064] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "network-844" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.048279] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock port-d96a5a02-0d1b-4d1c-b50b-c2c89266f233 taken with stack trace [, , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.049054] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "port-d96a5a02-0d1b-4d1c-b50b-c2c89266f233" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.049054] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "port-d96a5a02-0d1b-4d1c-b50b-c2c89266f233" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.049054] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "port-d96a5a02-0d1b-4d1c-b50b-c2c89266f233" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.049054] env[69656]: DEBUG networking_nsxv3.api.rpc [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d96a5a02-0d1b-4d1c-b50b-c2c89266f233',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.294951] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.295404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.295404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.295404] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.295598] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.295643] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.295729] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.295780] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.295927] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.296011] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.296098] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 is going to be updated. [ 1596.320089] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.320255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.320290] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.320467] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.320596] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.328859] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: IN_PROGRESS for 2s [ 1596.551227] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.551539] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.551584] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.551881] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.552052] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.552227] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Segment Port d96a5a02-0d1b-4d1c-b50b-c2c89266f233 not found, creating... [ 1596.552597] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.552789] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.552882] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.553124] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.553432] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.553562] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.553711] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.553837] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.554739] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.554739] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.554739] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Resource: SegmentPort with ID: d96a5a02-0d1b-4d1c-b50b-c2c89266f233 is going to be created. [ 1596.573245] env[69656]: DEBUG networking_nsxv3.common.locking [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.573454] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.573574] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.573832] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.574086] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.574319] env[69656]: DEBUG oslo_concurrency.lockutils [None req-b657755c-8cc7-4fea-a53d-05cb69e5bbc7 None None] Releasing lock "port-d96a5a02-0d1b-4d1c-b50b-c2c89266f233" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.701548] env[69656]: INFO networking_nsxv3.common.synchronization [req-4f4e4520-b562-401c-8952-20a62fb4a744 req-fdb25a85-ff50-488c-97e3-1e62101a3b9b service nova] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_rules [ 1597.701803] env[69656]: INFO networking_nsxv3.common.synchronization [req-4f4e4520-b562-401c-8952-20a62fb4a744 req-fdb25a85-ff50-488c-97e3-1e62101a3b9b service nova] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1597.701894] env[69656]: INFO networking_nsxv3.common.synchronization [req-4f4e4520-b562-401c-8952-20a62fb4a744 req-fdb25a85-ff50-488c-97e3-1e62101a3b9b service nova] Enqueued Resource ID: d96a5a02-0d1b-4d1c-b50b-c2c89266f233 with Priority: HIGHEST for action port [ 1597.702110] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_rules [ 1597.702240] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1597.702335] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96a5a02-0d1b-4d1c-b50b-c2c89266f233 with Priority: HIGHEST for action port [ 1597.702867] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.702993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.703146] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.703372] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.703486] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1597.704628] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.704764] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.705023] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock port-d96a5a02-0d1b-4d1c-b50b-c2c89266f233 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.705153] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d96a5a02-0d1b-4d1c-b50b-c2c89266f233" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.705240] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d96a5a02-0d1b-4d1c-b50b-c2c89266f233" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.705427] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d96a5a02-0d1b-4d1c-b50b-c2c89266f233" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.705532] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d96a5a02-0d1b-4d1c-b50b-c2c89266f233',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.207340] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.207672] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.208805] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d96a5a02-0d1b-4d1c-b50b-c2c89266f233 with status ACTIVE [ 1598.209010] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.209124] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.209198] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.209399] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.209488] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.209660] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.209836] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.209836] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.209975] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.210048] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.210229] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.210324] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.210386] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.210512] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.210581] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.210667] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d96a5a02-0d1b-4d1c-b50b-c2c89266f233 is going to be updated. [ 1598.231543] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.231685] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.231740] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.231855] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.231974] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.232131] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d96a5a02-0d1b-4d1c-b50b-c2c89266f233" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.351128] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: SUCCESS [ 1598.351307] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 deletion is rescheduled due to dependency. [ 1598.351428] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.351595] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.351813] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.351992] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.352122] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.352186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.352341] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.352422] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.352515] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.854590] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.356912] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1599.859405] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.859902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.859902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.859902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.859902] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.860057] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 is going to be updated. [ 1599.888484] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1599.888650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1599.888650] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1599.888844] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1599.888993] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1599.896949] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: IN_PROGRESS for 2s [ 1601.906944] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: SUCCESS [ 1601.907266] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.907321] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.907530] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.907726] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1601.907848] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1601.907935] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1601.908112] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1601.908190] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.908276] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.908364] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.411157] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1602.703698] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1602.703880] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1602.913472] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8: rpc.has_security_group_logging(os_id): False [ 1602.930932] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.930932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.930932] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.931204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.931204] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.931387] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.931497] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.931561] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.931722] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.931800] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.931884] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 is going to be updated. [ 1602.997091] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1602.997220] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1602.997255] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1602.997420] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1602.997555] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.007721] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: IN_PROGRESS for 2s [ 1605.020641] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: SUCCESS [ 1605.021012] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1607.704486] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1607.704953] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1612.705545] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1612.705887] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1617.706459] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1617.706855] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1622.707397] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1622.707397] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1627.708630] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1627.709131] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1632.709729] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1632.710116] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1637.710836] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1637.711328] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1642.711536] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1642.711792] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1647.712990] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1647.713400] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1652.714839] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1652.715157] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1656.688763] env[69656]: INFO networking_nsxv3.common.synchronization [req-933b94b9-57d3-46a9-9ede-4df891eb8801 req-682f9686-6513-4036-81aa-fa1a23625325 tempest-ServerActionsTestJSON-1918891154 tempest-ServerActionsTestJSON-1918891154-project-member] Enqueued Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1656.689625] env[69656]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 with Priority: HIGHEST for action security_group_members [ 1656.689932] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 taken with stack trace [, , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.690067] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.690219] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.691708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.691708] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.691708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.691708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.691708] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.691920] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.691920] env[69656]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8',) {} {{(pid=69656) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1657.194319] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.194526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.194526] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.194690] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.194785] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.194983] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.195097] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.195160] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.195317] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.195395] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.195483] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 is going to be updated. [ 1657.238837] env[69656]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69656) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.238994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.238994] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.239186] env[69656]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.239311] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.246705] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: IN_PROGRESS for 2s [ 1659.256576] env[69656]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 in Status: SUCCESS [ 1659.256897] env[69656]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8 deletion is rescheduled due to dependency. [ 1659.256897] env[69656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b9f51cf-8ba7-4d60-a0a7-5fa663f8dbd8" {{(pid=69656) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.691180] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1661.691500] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1666.693153] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1666.693555] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1671.694627] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1671.695037] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1676.695620] env[69656]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1676.695976] env[69656]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0